Provide Animators with expertise in creating dynamic motion prompts, optimized for AI video generation workflows.
Overview
This skill converts static 4-frame sequences into temporal motion descriptions, supporting:
- Subject Motion - Character actions, expressions, poses
- Camera Motion - Pan, Dolly, Crane, Orbit
- Natural Motion - Wind, water, light and shadow
- Platform Optimization - Runway Gen-3, Pika Labs, SVD, AnimateDiff
Core Principles
1. Simplicity over complexity
One main action, not multiple simultaneous actions
❌ Overly complex:
角色跑forward, 跳过obstacle, 空中旋转, 拔剑, 落地战斗姿态
✅ Stay focused and simple:
角色跑forward并跳过obstacle, 落地蹲姿。快速节奏。3秒。
2. Physical plausibility
Duration must match the action:
- 3 seconds: turning head, picking up an object, walking 2-3 steps
- 5 seconds: crossing a room, sitting down/standing up, opening a door and walking in
- ❌ Unrealistic: "run 100 meters" in 3 seconds, "complete battle" in 5 seconds
3. Motion first, details second
Simplify static descriptions, emphasize motion:
❌ Overly detailed (120+ words):
A 25-year-old woman with waist-length silver hair, pale skin, violet eyes,
wearing black coat over white shirt and black pants, silver ring on right hand,
walks from left to right...
✅ Motion first (25 words):
A woman with silver hair in a black coat walks from left to right across platform.
Steady pace. 4 seconds.
4. Specify the motion source
Clearly indicate what is moving:
- Subject motion: "Character walks left to right. Camera static."
- Camera motion: "Flower static. Camera pans right slowly."
- Combined: "Runner moves toward camera while camera dollies backward at matching speed."
Motion Prompt Structure Template
[简化主体描述] [主要动作] [方向].
[镜头运动(如有)]. [速度描述]. [时长].
Example:
A woman with silver hair in a crimson coat walks from left to right along
a train platform, wind blowing her hair. Camera pans right to follow her.
Steady walking pace. 5 seconds.
Quick Start
Step 1: Analyze the Sequence Board
Identify the key motion in the 4-frame sequence:
- Frame 1 → Frame 2: What changed?
- Did the subject move? Did the camera move?
- Is there natural motion in the environment (wind, water, light)?
Step 2: Choose one main action
Don't try to describe all changes, choose thesingle most important one。
Step 3: Specify direction
Use clear directional words:
- left to right / right to left
- toward camera / away from camera
- background to foreground
- clockwise / counterclockwise
Step 4: Choose speed
Refer to MOTION_LIBRARY.md speed guidance:
- Slow (4-5 seconds): slowly, gradually, gently
- Medium (3-4 seconds): walks, moves, steady pace
- Fast (2-3 seconds): quickly, swiftly, rushes
Step 5: Determine duration
Based on platform and motion complexity:
- Runway Gen-3: 3-5 seconds
- Pika Labs: 3-4 seconds
- SVD: 2-4 seconds
- AnimateDiff: 1-3 seconds
Output Constraints
Strictly prohibited:
- ❌ Frontmatter metadata
- ❌ Template explanations
- ❌ Lengthy descriptions over 80 words
- ❌ Multiple competing actions
- ❌ Physically impossible motion
Must include:
- ✅ Concise description of 40-80 words
- ✅ One clear main action
- ✅ Motion direction
- ✅ Speed/pace
- ✅ Duration
- ✅ Distinction between subject vs camera motion
Detailed Resources
Methodology Guide 📖
- motion-prompt-methodology.md - Motion prompt principles
- Simplicity and focus
- Direction and speed specification
- Subject and camera motion distinction
- Physical plausibility of video duration
- Video model optimization techniques
Motion Type Library 📖
- MOTION_LIBRARY.md - Complete motion reference
- Subject motion library (character movement, actions, expressions)
- Camera motion library (Pan, Dolly, Crane, Orbit)
- Natural motion (wind, water, light and shadow)
- Motion speed guidance (slow/medium/fast)
- Platform characteristics and optimization (Runway, Pika, SVD, AnimateDiff)
- Physical plausibility check
- Common motion combination examples
Template
- templates/motion-prompt-template.md - Output format
When to use
Automatic trigger scenarios:
- User requests "generate motion prompts"
- Approved sequence board needs to be converted to video
- Director feedback on motion clarity issues
Manual reference scenarios:
- Select appropriate motion type
- Determine motion speed
- Optimize platform-specific format
- Check physical plausibility
Platform quick selection
- Complex motion → Runway Gen-3
- Quick generation → Pika Labs
- Local deployment → Stable Video Diffusion
- Stylized animation → AnimateDiff
Common errors and solutions
❌ Error: Too verbose
(120+ words with excessive scene description)
✅ Solution: Simplify the scene, emphasize motion (~25 words)
❌ Error: Multiple actions
角色跑、跳、旋转、拔剑、落地
✅ Solution: Choose one primary action
❌ Error: Ambiguous direction
角色在房间里移动
✅ Solution: Clarify direction "from background to foreground"
Usage: Animator agent automatically references this skill. Methodology and libraries (marked 📖) use progressive disclosure, consulted only when needed.