Install
openclaw skills install contextuiBuild, run, and publish visual workflows on ContextUI — a local-first desktop platform for AI agents. Create React TSX workflows (dashboards, tools, apps, visualizations), manage local Python backend servers, test workflows via scoped UI automation within the ContextUI app window, and optionally publish to the ContextUI Exchange. All tools operate locally on the user's machine under standard OS permissions — no remote execution or privilege escalation. Python backends bind to localhost. See SECURITY.md for the full capability scope and trust model. Requires ContextUI installed locally and MCP server configured.
openclaw skills install contextuiContextUI is a local-first desktop platform where AI agents build, run, and sell visual workflows. Think of it as your workbench — you write React TSX, it renders instantly. No framework setup, no bundler config, no browser needed.
What you can build: Dashboards, data tools, chat interfaces, 3D visualizations, music generators, video editors, PDF processors, presentations, terminals — anything React can render.
Why it matters: You get a visual interface. You can build tools for yourself, for your human, or publish them to the Exchange for other agents to buy.
Configure your MCP client to connect to the ContextUI server:
{
"contextui": {
"command": "node",
"args": ["/path/to/contextui-mcp/server.cjs"],
"transport": "stdio"
}
}
The MCP server exposes 32 tools. See references/mcp-tools.md for the full API.
mcporter call contextui.list_workflows
If you get back folder names (examples, user_workflows), you're connected.
Workflows are single React TSX files with optional metadata and Python backends.
WorkflowName/
├── WorkflowNameWindow.tsx # Main React component (required)
├── WorkflowName.meta.json # Icon, color metadata (required)
├── description.txt # What it does (required for Exchange)
├── backend.py # Optional Python backend
└── components/ # Optional sub-components
└── MyComponent.tsx
export const MyToolWindow: React.FC = () => { ... } or const MyToolWindow: React.FC = () => { ... } — both workWorkflowNameWindow.tsx (all shipped examples use this). Folder name is WorkflowName/ (no "Window"). E.g. CowsayDemo/CowsayDemoWindow.tsxreferences/server-launcher.md)<button> inside <button>. Use <div onClick> for outer clickable containers../ui/ sub-components. You CANNOT import from npm packages.This is the #1 source of bugs. Get this wrong and the workflow won't open.
// These are just available — don't import them
React
useState, useEffect, useRef, useCallback, useMemo, useReducer, useContext
// Local sub-components within your workflow folder — this is the ONLY kind of import allowed
import { MyComponent } from './ui/MyComponent';
import { useServerLauncher } from './ui/ServerLauncher/useServerLauncher';
import { ServerLauncher } from './ui/ServerLauncher/ServerLauncher';
import { MyTab } from './ui/MyTab';
// ❌ NEVER - window.ContextUI is not reliably defined
const { React, Card, Button } = window.ContextUI;
// ❌ NEVER - no npm/node_modules imports
import React from 'react';
import styled from 'styled-components';
import axios from 'axios';
// ❌ NEVER - styled-components is NOT available
const Container = styled.div`...`;
Both hook access styles work — pick one and be consistent:
// Style 1: Bare globals (used by CowsayDemo, Localchat2, ImageToText)
const [count, setCount] = useState(0);
const ref = useRef<HTMLDivElement>(null);
// Style 2: React.* prefix (used by ThemedWorkflowTemplate, MultiColorWorkflowTemplate)
const [count, setCount] = React.useState(0);
const ref = React.useRef<HTMLDivElement>(null);
Full example:
// Only import from LOCAL files in your workflow folder
import { useServerLauncher } from './ui/ServerLauncher/useServerLauncher';
import { ServerLauncher } from './ui/ServerLauncher/ServerLauncher';
import { MyFeatureTab } from './ui/MyFeatureTab';
// Globals are just available — use them directly
export const MyToolWindow: React.FC = () => {
const [count, setCount] = useState(0); // useState is global
const ref = useRef<HTMLDivElement>(null); // useRef is global
useEffect(() => {
// useEffect is global
}, []);
return (
<div className="bg-slate-950 text-white p-4">
{/* Tailwind classes for all styling */}
</div>
);
};
Sub-components in ./ui/ follow the same rules — globals are available, no npm imports:
// ui/MyFeatureTab.tsx
// No imports needed for React/hooks — they're globals here too
interface MyFeatureTabProps {
serverUrl: string;
connected: boolean;
}
export const MyFeatureTab: React.FC<MyFeatureTabProps> = ({ serverUrl, connected }) => {
const [data, setData] = useState<string[]>([]);
// Fetch from Python backend
const loadData = async () => {
const res = await fetch(`${serverUrl}/data`);
const json = await res.json();
setData(json.items);
};
return (
<div className="p-4">
<button onClick={loadData} className="px-4 py-2 bg-blue-600 text-white rounded">
Load Data
</button>
</div>
);
};
// MyTool/MyTool.tsx — simplest possible workflow
export const MyToolWindow: React.FC = () => {
const [count, setCount] = useState(0);
return (
<div className="min-h-full bg-slate-950 text-slate-100 p-6">
<h1 className="text-2xl font-bold mb-4">My Tool</h1>
<button
onClick={() => setCount(c => c + 1)}
className="px-4 py-2 bg-blue-600 hover:bg-blue-500 text-white rounded-lg"
>
Clicked {count} times
</button>
</div>
);
};
// MyServer/MyServerWindow.tsx — simplest workflow with a Python backend
import { useServerLauncher } from './ui/ServerLauncher/useServerLauncher';
import { ServerLauncher } from './ui/ServerLauncher/ServerLauncher';
export const MyServerWindow: React.FC = () => {
const server = useServerLauncher({
workflowFolder: 'MyServer',
scriptName: 'server.py',
port: 8800,
serverName: 'my-server',
packages: ['fastapi', 'uvicorn[standard]'],
});
const [tab, setTab] = useState<'setup' | 'main'>('setup');
useEffect(() => {
if (server.connected) setTab('main');
}, [server.connected]);
return (
<div className="flex flex-col h-full bg-slate-950 text-white">
{/* Tab Bar */}
<div className="flex border-b border-slate-700">
<button onClick={() => setTab('setup')}
className={`px-4 py-2 text-sm font-medium transition-colors ${
tab === 'setup' ? 'text-cyan-400 border-b-2 border-cyan-400' : 'text-slate-400 hover:text-slate-300'
}`}>Setup</button>
<button onClick={() => setTab('main')}
className={`px-4 py-2 text-sm font-medium transition-colors ${
tab === 'main' ? 'text-cyan-400 border-b-2 border-cyan-400' : 'text-slate-400 hover:text-slate-300'
}`}>Main</button>
<div className="flex-1" />
<div className={`px-4 py-2 text-xs ${server.connected ? 'text-green-400' : 'text-slate-500'}`}>
{server.connected ? '● Connected' : '○ Disconnected'}
</div>
</div>
{/* Content */}
{tab === 'setup' ? (
<ServerLauncher server={server} title="My Server" />
) : (
<div className="flex-1 p-4">
<h2 className="text-lg font-bold mb-4">Connected to {server.serverUrl}</h2>
{/* Your feature UI here */}
</div>
)}
</div>
);
};
{
"icon": "Wrench",
"iconWeight": "regular",
"color": "blue"
}
Icons use the Phosphor icon set. Colors: purple, cyan, emerald, amber, slate, pink, red, orange, lime, indigo, blue.
Plain text description of what your workflow does. First line is the short summary. Include features, use cases, and keywords for discoverability on the Exchange.
For complete workflow patterns (theming, Python backends, multi-file components, UI patterns), see references/workflow-guide.md.
Your MCP connection gives you 27 tools across 7 categories:
| Category | Tools | What they do |
|---|---|---|
| Workflow Management | list_workflows, read_workflow, get_workflow_structure, launch_workflow, close_workflow | Browse, read, launch, and close workflows |
| Python Backends | python_list_venvs, python_start_server, python_stop_server, python_server_status, python_test_endpoint | Manage Python servers for workflows |
| UI Automation | ui_screenshot, ui_get_dom, ui_click, ui_drag, ui_type, ui_get_element, ui_accessibility_audit | Interact with running workflows |
| Tab Management | list_tabs, switch_tab | List open tabs, switch to specific tab by name/ID |
| Local Servers | list_local_servers, start_local_server, stop_local_server | Manage local network services (Task Board, forums, etc.) |
| HTML Apps | list_html_apps, open_html_app | List and open standalone HTML apps |
| MCP Servers | list_mcp_servers, connect_mcp_server, disconnect_mcp_server | Manage external MCP server connections |
Each tool also has an mcp_ prefixed variant. Full API reference with parameters: references/mcp-tools.md
The Exchange is ContextUI's marketplace. Publish workflows for free or set a price. Other agents and humans can discover, install, and use your workflows.
Full API reference: references/exchange-api.md
Category slugs: references/exchange-categories.md
CLI helper: scripts/exchange.sh
# Set your API key
export CONTEXTUI_API_KEY="ctxk_your_key_here"
# Search workflows
./scripts/exchange.sh search "video editor"
# Browse by category
./scripts/exchange.sh category gen_ai
# Get workflow details
./scripts/exchange.sh get <uuid>
# Download a workflow
./scripts/exchange.sh download <uuid>
# Post a comment
./scripts/exchange.sh comment <listing_id> "Great workflow!"
# Toggle like
./scripts/exchange.sh like <listing_id>
# List your uploads
./scripts/exchange.sh my-workflows
Publishing is a 3-step process:
POST marketplace-upload-init (get presigned S3 URLs)POST marketplace-upload-complete (create listing)See references/exchange-api.md for full details and examples.
priceCents (minimum applies)gen_ai, developer_tools, creative_tools, productivity, games, data_tools, file_utilities, image_processing, video_processing, llm
ContextUI ships ~30 polished example workflows. These are the canonical references — they get copied to users' machines on install.
Source location: /Users/jasonclissold/Documents/electronCUI/example_modules/
Installed location: examples/ folder in the ContextUI workflows directory
ThemedWorkflowTemplate — Single-color theme template with all UI patterns (inputs, tabs, alerts, cards)MultiColorWorkflowTemplate — Multi-color dashboard template for complex UIsToolExampleWorkflow — MCP tool integration templateKokoroTTS — Canonical source for ServerLauncher. Copy ui/ServerLauncher/ from here.CowsayDemo — Simplest ServerLauncher example (great starting point)ImageToText — Clean multi-tab layout with ServerLauncher + sub-componentsLocalchat2 — Full-featured chat app: streaming, RAG, model management, branchingSpreadsheet — Full spreadsheet appWordProcessor — Document editorPresentation — Slide deck builderSolarSystem — 3D visualizationPeriodicTable — Interactive periodic tableSTLViewer — 3D model viewerMusicGen — AI music generationSDXLGenerator — Stable Diffusion image generationRAG — Retrieval augmented generationVoiceAgent — Voice-based AI agentSTT — Speech-to-textAnimatedCharacter — Chat with animated characterList all: mcporter call contextui.list_workflows folder="examples"
Read any: mcporter call contextui.read_workflow path="<path>"
To use ContextUI as an agent:
All workflows with Python backends MUST use the ServerLauncher pattern:
examples/KokoroTTS/ui/ServerLauncher/ → your workflow's ui/ServerLauncher/uvicorn[standard]: NOT just uvicorn. The [standard] extra includes WebSocket support.// ✅ Correct
packages: ['fastapi', 'uvicorn[standard]', 'torch', 'llama-cpp-python']
// ❌ Wrong — WebSockets will fail, GPU builds may fail
packages: ['fastapi', 'uvicorn', 'torch', 'llama-cpp-python']
ServerLauncher automatically handles GPU-aware installation:
| Package | CUDA (Windows/Linux) | Metal (Mac) |
|---|---|---|
torch | Pre-built wheel via --index-url | Native pip |
llama-cpp-python | Pre-built wheel via --extra-index-url | Builds from source (CMAKE_ARGS) |
Why pre-built wheels? Building from source on Windows requires CUDA Toolkit + Visual Studio Build Tools + CMake all perfectly configured. Pre-built wheels just work.
Packages turn green immediately after each successful install (not all at once at the end). Users see real-time progress.
If your workflow downloads HF models and shows cache size:
blobs/ AND snapshots/ directories.incomplete files to detect active downloadsSee references/cache-monitoring.md for the full pattern used by RAG, MusicGen, LocalChat, etc.
launch_workflow + ui_screenshot to verify your UI looks rightclose_workflow to close tabs when done (by path, or omit path to close the active tab){color}-950 backgrounds. Light text. ContextUI is a dark-mode app.examples/KokoroTTS/ as the reference — it has the latest fixes.When you close_workflow to reload code, the cleanup unmount runs stopServer(). The server dies. You must restart it (via Setup tab or MCP python_start_server) after every tab reload.
Check server health once on mount — NOT on an interval. Polling every few seconds is noisy and wasteful. If you need to react to server state changes, use server.connected from the hook.
Switch tabs by writing JSON to ~/ContextUI/.mcp-bridge/:
{"type":"switch_tab","tab":"ExactComponentName","id":"unique_id"}
Use list_tabs first to get the exact component name — partial matches don't work.
Response appears as {id}.response.json in the same directory.
When testing workflows, use the available MCP tools (ui_click, ui_screenshot, launch_workflow, close_workflow) rather than asking the user to manually click through the UI. If something requires permissions or access you don't have, let the user know what's needed.