OpenClaw ComfyUI

v1.0.4

Connect and control ComfyUI API efficiently using template mapping and auto-asset management for image generation and editing tasks.

10· 2.3k·16 current·18 all-time
Security Scan
VirusTotalVirusTotal
Benign
View report →
OpenClawOpenClaw
Benign
high confidence
Purpose & Capability
Name/description claim: connect to and control ComfyUI for image generation/editing. The repository contains workflow JSONs and a Python client that reads a ComfyUI host from workspace TOOLS.md and performs uploads, prompts, polling, and downloads — exactly what is needed to implement the described capability.
Instruction Scope
SKILL.md instructs the agent to run the bundled comfy_client.py with a template_id and prompt. The script reads workspace TOOLS.md for Host/Port, substitutes prompts into local workflow JSONs, uploads any provided local input files to the configured ComfyUI host, polls for results, and downloads generated files to outputs/comfy/. These actions are within scope for controlling a ComfyUI instance, but be aware the script will upload any input file you pass (allowed extensions include images, video, audio). Also the included workflow JSONs embed explicit/sexual prompt text — review content policy implications before use.
Install Mechanism
Instruction-only skill with a visible Python script. No install spec or remote download/exec behavior is present. The only runtime dependency is the requests Python package (mentioned in README), which is reasonable for the task.
Credentials
The skill requests no environment variables or credentials. It reads a local TOOLS.md file to get the ComfyUI host/port; this is reasonable for a tool intended to contact a ComfyUI server. There are no unrelated credentials or config paths requested.
Persistence & Privilege
always:false and user-invocable:true. The skill does not alter other skills or system-wide configs. It runs only when invoked and only touches its own workflows and outputs directory.
Assessment
This skill appears to do what it claims, but check these before installing: 1) Verify the TOOLS.md host/port entry points to a trusted ComfyUI server (the script will upload local files to that host — if TOOLS.md points to an untrusted remote, sensitive files could be transmitted). 2) Only pass input files you intend to upload; the script will POST them to the configured host. 3) Inspect workflows/ for any embedded prompts (the included JSONs contain explicit sexual content and may violate usage policies). 4) Run the skill in a constrained environment (local or isolated VM/container) if you are unsure about the target ComfyUI host. 5) Ensure Python dependencies (requests) are installed from trusted sources. If you want additional assurance, review or run the Python script locally with a deliberately misconfigured or local-only TOOLS.md to observe behavior before enabling agent-autonomous calls.

Like a lobster shell, security has layers — review code before you run it.

latestvk9704gmca11cmhgsz3cb90nsms81efrj
2.3kdownloads
10stars
3versions
Updated 1mo ago
v1.0.4
MIT-0

ComfyUI-OpenClaw Skill 🎨✨

A professional, token-saving agent skill for connecting and controlling ComfyUI via API. Designed for high efficiency, automatic asset handling, and seamless integration with OpenClaw.

🏗️ Skill Structure

  • Host Address: 192.168.1.38:8190 (Configured in TOOLS.md)
  • Workflow Directory: skills/comfyui/workflows/ (Self-contained within the skill folder)
  • Output Directory: outputs/comfy/ (Relative to workspace root)
  • Core Script: skills/comfyui/comfy_client.py (Handles prompt injection, image uploads, and result polling)

🛠️ Tools (CLI)

Invoke via the exec command: python3 skills/comfyui/comfy_client.py <template_id> "<prompt>" [input_image_path/orientation] [orientation]

Parameters:

  • template_id:
    1. gen_z: Text-to-Image (uses image_z_image_turbo.json)
    2. qwen_edit: Image-to-Image / Editing (uses qwen_image_edit_2511.json) - Supports automatic image upload.
  • prompt: The description of the image to generate or edits to perform.
  • input_image_path: (Optional) Local path for image-to-image tasks.
  • orientation: (Optional) Set to portrait (720x1280) or landscape (1280x720). Defaults to portrait.

💡 How to Add New Workflows

You can expand this skill easily:

  1. Place your new API-formatted JSON workflow in skills/comfyui/workflows/.
  2. Update the WORKFLOW_MAP dictionary in skills/comfyui/comfy_client.py with a new ID and the file path.
  3. (Optional) If the workflow uses unique node types, adjust the injection logic in the script's main() function.

🚀 Token-Saving Strategy

  • Template Mapping: Never send full workflow JSONs in the chat. Refer to them by template_id.
  • Vision-Saving Strategy: To minimize token usage, the agent should prioritize using the file path from metadata instead of analyzing image content via vision capabilities unless explicitly asked to describe or analyze the image.
  • Direct Delivery: Deliver images directly to users via messaging plugins (e.g., Telegram) or local file openers (open) to avoid bloating the LLM's context window with base64 data.

Comments

Loading comments...