comfy-pilot

Purpose

Comfy Pilot is designed to let users interact with ComfyUI workflows through natural language. It provides an MCP server and an embedded terminal, enabling Claude Code to directly access, view, edit, and run ComfyUI workflows, thereby reducing the operations of manually searching for nodes, dragging connections, and adjusting parameters one by one.

Main Capabilities

• MCP Server: Provides Claude Code with direct access to view, edit, and run ComfyUI workflows.
• Embedded Terminal: Runs a full xterm.js terminal within the ComfyUI interface and launches Claude Code.
• Image Viewing: Claude can view the outputs of "Preview Image" and "Save Image" nodes.
• Graph Editing: Can programmatically create, delete, move, and connect nodes.
• Model Download: Download models to the ComfyUI models folder via download_model from Hugging Face (including gated models that require token authentication) or direct download URLs.

Usage

1. Installation (CLI recommended): Install via ComfyUI Manager—click Manager → Install Custom Nodes → search for "Comfy Pilot" → restart ComfyUI. If the Claude Code CLI is not found, it will be installed automatically.
2. After restarting ComfyUI, a floating Claude Code terminal will appear in the upper right corner, and the MCP server will automatically be configured for Claude Code.
3. Make workflow-related requests to Claude, for example:
   • "What nodes are in my current workflow?"
   • "Add a KSampler node connected to my checkpoint loader"
   • "Look at the preview image and tell me what you see"
   • "Run the workflow up to node 5"
   • "Build me an SDXL workflow with ControlNet"
   • "Look at the output and increase the detail"
   • "Download the FLUX schnell model and set up a workflow for it"

Terminal Controls

• Drag the title bar to move the terminal
• Drag the lower right corner to resize the terminal
• Click the ↻ button to reconnect the session

Main Files

• __init__.py: Plugin backend, including the WebSocket terminal and REST endpoints
• js/claude-code.js: Frontend, including the xterm.js terminal and workflow synchronization
• mcp_server.py: MCP server for Claude Code integration
• CLAUDE.md: Operating instructions for Claude when handling ComfyUI

Troubleshooting

• "Command 'claude' not found": The Claude Code CLI needs to be installed. The original text does not provide the specific code content for the installation commands for macOS / Linux / WSL and Windows (PowerShell).
• MCP server not connected: The plugin automatically configures MCP on startup; you can check the ComfyUI console for errors, or manually add it to ~/.claude.json.
• Terminal disconnected: Click the ↻ button to reconnect, or check the ComfyUI console for errors.

Applicable Scenarios and Limitations

Suitable for users who want to quickly build, adjust, and run ComfyUI workflows through natural language, especially in scenarios using Claude Code. The materials do not provide more details about fees, pricing, platform support scope, performance results, etc., and none are currently provided.