SuperAPI AI Directory
Partner with us中文AI newsFavorites
SkillsMultimodal Studio

Multimodal Studio

Design & creation

View repository

Updated 10-15 21:46

About this skill

Multimodal Studio

One connector. Image + video + consistent characters. Thirty-plus models, vendor-agnostic, brand-locked.

Purpose

Turn a creative brief into finished visual assets — images, videos, and reusable characters — without leaving the agent loop. Multimodal Studio is ACOS's unified generation layer: it routes each request to the right model, engineers the prompt, holds brand and character consistency across a whole asset set, and handles the async generation lifecycle end to end.

This is the capability that closes the gap with agent-first platforms like Google Antigravity — except ACOS stays model-agnostic (no lock-in to one vendor's image/video stack) and brand-aware (every asset inherits Frank DNA + project brand tokens).

When to Use This Skill

  • Generating a hero image, thumbnail, OG card, or social visual for a piece of content
  • Producing short-form video, b-roll, or a cinematic clip from a still or a prompt
  • Creating a reusable character that stays consistent across many images and videos
  • Building a coordinated asset set (article header + 3 social cards + a 5s teaser) that must look like one campaign
  • Any time a workflow says ~~image generation or ~~video generation

The Connector (Higgsfield MCP — default)

ACOS's default multimodal connector is Higgsfield MCP — one OAuth connection exposes 30+ image and video models plus character training. Per CONNECTORS.md, this skill is tool-agnostic: any MCP that fills the ~~image generation / ~~video generation categories works. Higgsfield is the default because a single server covers all three modalities with consistent characters.

Connect (Claude Code):

claude mcp add --transport http --scope user higgsfield https://mcp.higgsfield.ai/mcp
# then authenticate via OAuth in your Higgsfield account — no API keys to manage

Self-hosted alternative (stdio + API keys): see resources/model-matrix.md.

Tools exposed: generate_image, generate_video, create_character, list_characters, get_generation_status.

Verify before generating: if the higgsfield tools are not available, do NOT silently fall back to describing images in text. Tell the operator the connector is missing and give them the one-line claude mcp add command above.

The Workflow (BRIEF → ROUTE → CRAFT → GENERATE → ASSEMBLE)

1. BRIEF — lock intent before spending a generation

Capture (ask only for what's missing; infer the rest from project context):

  • Goal & placement — where does this live? (blog hero, IG reel, YouTube thumbnail, OG card)
  • Aspect ratio & resolution — derive from placement (see matrix); never ask if placement implies it
  • Style — photoreal / 3D / illustration / minimalist / cinematic (inherit brand tokens if a brand skill is active)
  • Character? — is there a recurring subject that must stay consistent across assets?
  • Modality — still, video, or both (image → animate is the cheapest path to video)

2. ROUTE — pick the model deliberately (see resources/model-matrix.md)

Routing heuristics:

  • Photoreal stills, people, products → Soul (4K, strong on faces/brand)
  • Stylized / illustration / typography-in-image → Flux or Seedream
  • Cinematic motion from a still → image-to-video (Kling / Hailuo / DoP)
  • Text-to-video, complex scenes → Veo / Sora-class
  • Recurring subject across the set → create_character once, then reference its ID in every call Always state which model you chose and why in one line before generating.

3. CRAFT — engineer the prompt

Structure every visual prompt as: Subject + Action + Setting + Composition + Lighting + Style + Technical.

  • Lead with the subject and the single most important visual idea.
  • Specify camera/lens/lighting for photoreal ("85mm, soft key light, shallow depth of field").
  • For video, describe motion explicitly (camera move + subject motion + pacing); models default to static otherwise.
  • Inject brand tokens (palette, mood, typography rules) when a brand skill is loaded.
  • Negative space and aspect ratio are part of the prompt, not an afterthought.

4. GENERATE — handle the async lifecycle

  • Generation is asynchronous. Submit, capture the job ID, then poll get_generation_status — do not assume instant results. Images: seconds. Video: tens of seconds to minutes.
  • Submit independent assets in parallel (multiple generate_image calls in one turn), then poll. This is the multi-asset speed advantage.
  • On failure or content-policy rejection: report it plainly, adjust the prompt, retry once — don't loop silently.
  • Save returned assets to the project's canonical asset path; never leave them only as URLs.

5. ASSEMBLE — deliver a coherent set

  • Verify the set reads as one campaign (same character ID, palette, lighting language).
  • Produce required derivatives (e.g. crop hero → OG 1200×630, square 1080×1080).
  • Log what was generated (model, prompt, job ID) so it's reproducible and auditable.

Character Consistency (the differentiator)

For any recurring subject (a brand mascot, a course instructor avatar, a series protagonist):

  1. create_character once from a reference image or description → get a character ID.
  2. Reference that ID in every subsequent generate_image / generate_video call.
  3. list_characters to reuse across sessions and projects. This is how you get a character that looks identical across an entire content series — the thing single-shot image tools cannot do.

Quality Bar (Frank DNA)

  • Show, don't tell — the asset is the proof; don't describe what you'll make, make it.
  • Premium by default — highest sensible resolution, deliberate composition, no AI-slop tells (mangled hands, garbled text, plastic skin). Inspect output and regenerate if it has them.
  • Brand-locked — if a brand skill is active, every asset obeys its palette/voice/tokens.
  • Reproducible — log model + prompt + seed/job ID for every keeper.
  • Cost-aware — image-to-video before text-to-video; lower res for drafts, 4K for finals.

Composes With

  • frankx-brand / brand-guidelines → brand tokens for generation
  • content-strategy / video-script → briefs that feed the studio
  • suno-mastery → score the videos this skill produces
  • infogenius command → research-grounded image prompts
  • /studio and /generate-video commands → operator entry points

Reference

  • resources/model-matrix.md — full model selection matrix, aspect-ratio table, self-hosted config, cost tiers