Generate video from audio using fal.ai LTX-2.5 Pro (lightricks/ltx-2.5/audio-to-video/pro).
Usage
cd /Users/aviz/.claude/skills/audio-to-video/scripts
npx ts-node generate.ts \
--audio "/path/to/audio.mp3" \
--image "/path/to/frame.jpg" \
-d /tmp/output.mp4 \
"Cinematic description of motion and action"
Flags
| Flag | Description |
|---|---|
--audio, -a |
Audio file (mp3/wav/ogg/m4a/aac) — Pro max 10 seconds |
-d, --destination |
Output video path (required) |
--image, -i |
Starting frame image (highly recommended) |
--end-image |
Ending frame image (image-to-video only) |
--size, -s |
Video size (see below) |
--fps |
Frames per second (24/25) — image-to-video only |
--quality |
low=720p, high=1080p — image-to-video only |
--guidance-scale |
Default: 9 with image, 5 without |
Endpoints (LTX 2.5)
| Mode | Endpoint |
|---|---|
| Audio + (optional image) | lightricks/ltx-2.5/audio-to-video/pro |
| Image only (no audio) | lightricks/ltx-2.5/image-to-video/pro |
Script auto-selects based on whether --audio is provided.
Video Sizes
landscape_16_9 (default), portrait_16_9, landscape_4_3, square_hd, auto
Audio Limit
Pro max 10 seconds per clip (API range 2–20s, Pro caps at 10). Split longer shots.
API Key
Uses FAL_KEY from ~/.claude/skills/image-generation/scripts/.env
Writing Strong Prompts
The prompt drives video motion. Include:
- Subject action — what is moving and how ("singer throwing head back mid-note")
- Camera movement — "slow dolly in", "whip pan", "handheld shake"
- Lighting event — "strobe burst", "spotlight sweep", "laser beams"
- Emotion/energy — "euphoric", "intense", "raw power"
- Environment — "fog rolling across stage", "confetti mid-air"
Example:
"LIVE ARENA CONCERT: Female singer throwing head back mid-high-note, hair arcing in slow motion.
Camera: slow push in. Lighting: single white spotlight with rim halo.
Fog at feet, pure emotional catharsis. Hyper-real 4K cinema"