AI Video Generation · runcomfy-com/skills · Skills Docs

Skills

Chapter 5 of 30

AI Video Generation

Generate AI videos on RunComfy via the runcomfy CLI — a smart router across the full video-model catalog: HappyHorse 1.0 (Arena #1, native in-pass audio), Wan-AI Wan 2-7 (open…

8 minutes · 1,710 words · 39 sections

Generate videos with the full RunComfy video-model catalog through one CLI — text-to-video, image-to-video, and Veo’s video-extend. This skill picks the right model for the user’s intent and ships the documented prompt patterns + the exact runcomfy run invoke for each.

runcomfy.com (opens in a new tab) · Video models (opens in a new tab) · CLI docs (opens in a new tab)

Powered by the RunComfy CLI

Install this repository

$ npx skills add runcomfy-com/skills

Skills install per repository, not per chapter — the CLI has no documented per-skill form, so we do not print one.

About this skill

Trigger

Generate AI videos on RunComfy via the `runcomfy` CLI — a smart router across the full video-model catalog: HappyHorse 1.0 (Arena #1, native in-pass audio), Wan-AI Wan 2-7 (open weights, audio-driven lip-sync), ByteDance Seedance v2 / 1-5 / 1-0 (multi-modal cinematic), Kling 3.0 / 2-6, Google Veo 3-1, MiniMax Hailuo 2-3, ByteDance Dreamina 3-0. Covers text-to-video (t2v), image-to-video (i2v), and Veo's video-extend endpoint. The skill picks the right model for the user's intent (Arena-#1 quality, multi-shot character identity, in-pass audio, cinematic motion, fastest path, sub-15s clip, longest duration) and ships each model's documented prompting patterns plus the minimal `runcomfy run` invoke. Triggers on "generate video", "make a video", "text to video", "t2v", "image to video", "i2v", "animate", "AI video", "make X move", "video from prompt", "video from image", or any explicit ask to produce a video clip from prompt or still.

The verbatim description from this skill’s front matter — the string an agent matches on to decide whether to load it.

Allowed tools: Bash(runcomfy*)
Licence: MIT
Source: ai-video-generation/SKILL.md

Colophon for this issue

Colophon

How this issue was made

Source

github.com/runcomfy-com/skills, branch main, last pushed 18 May 2026.

Licence

MIT — the text of every chapter is reproduced unmodified, frontmatter included, under the upstream licence.

Discovery

30 chapters found by walking the repository tree for SKILL.md, not by matching a directory convention. One layout observed: */SKILL.md.

Issue colours

Resolved from a deterministic hash of the owner name. Two accent tones are generated per issue and each is proven against its own ground before it ships: a single accent that passes AA on both light and dark paper is arithmetically impossible.

Heading repairs

1 repair applied to this chapter so the document has one h1 and no skipped levels:

Removed “AI Video Generation”, a leading h1 that duplicated the chapter title.

Spec compliance

1 editorial note across 1 of 30 chapters. They are printed in the margin of each chapter rather than as errors here.

AI Music — 1 note

Images

Images inside a chapter come from the upstream repository. Where the author gave no alternative text we mark the image decorative rather than inventing a description — a plausible caption we made up is worse than none for the reader who depends on it.

Signal

This repository is unranked on skills.sh, which says nothing about it: the leaderboard covers a fraction of published skills.

Agent surfaces

The whole issue is available as one markdown document at /runcomfy-com/skills.md, and each chapter at its own .md URL.

Publication

Set by Skills Docs from the source repository. Body text is Literata at the reader’s chosen size and measure; code is Geist Mono. Nothing on this page was written by us except this paragraph.

# 1. Install (see runcomfy-cli skill for details)
npm i -g @runcomfy/cli      # or:  npx -y @runcomfy/cli --version

# 2. Sign in
runcomfy login              # or in CI: export RUNCOMFY_TOKEN=<token>

# 3. Generate
runcomfy run <vendor>/<model>/<endpoint> \
  --input '{"prompt": "..."}' \
  --output-dir ./out

Field	Type	Required	Default	Notes
`prompt`	string	yes	—	Subject-first, describe motion + scene + audio in one declarative
`duration`	int	no	5	Seconds. Up to ~15s
`aspect_ratio`	enum	no	`16:9`	`16:9`, `9:16`, `1:1` typical
`resolution`	enum	no	`1080p`	`720p`, `1080p`
`seed`	int	no	—	Reproducibility

runcomfy run happyhorse/happyhorse-1-0/text-to-video \
  --input '{
    "prompt": "A red kite tumbles across a windy beach at golden hour, kids chasing it laughing, surf in the background. Audio: wind, gulls, distant laughter.",
    "duration": 8,
    "aspect_ratio": "16:9",
    "resolution": "1080p"
  }' \
  --output-dir ./out

runcomfy run wan-ai/wan-2-7/text-to-video \
  --input '{
    "prompt": "Studio portrait of a woman in her 30s speaking confidently to camera, soft window light.",
    "audio_url": "https://your-cdn.example/voiceover.mp3",
    "duration": 6
  }' \
  --output-dir ./out

runcomfy run bytedance/seedance-v2/pro \
  --input '{
    "prompt": "Anamorphic 35mm shot — a vintage car drives down a coastal road at dusk, lens flares from oncoming headlights, cinematic color grade.",
    "duration": 10,
    "aspect_ratio": "21:9"
  }' \
  --output-dir ./out

runcomfy run happyhorse/happyhorse-1-0/image-to-video \
  --input '{
    "image_url": "https://your-cdn.example/portrait.jpg",
    "prompt": "She turns her head slowly to look at the camera and smiles. Wind through her hair. Audio: gentle breeze.",
    "duration": 6,
    "aspect_ratio": "9:16"
  }' \
  --output-dir ./out

runcomfy run google-deepmind/veo-3-1/image-to-video \
  --input '{
    "image_url": "https://your-cdn.example/product.jpg",
    "prompt": "The bottle slowly rotates 180 degrees on a marble surface, soft daylight, no other motion."
  }' \
  --output-dir ./out

Tier	Endpoint	When
4K	`kling/kling-3.0/4k/image-to-video`	Hero shots, final delivery at 4K
Pro	`kling/kling-3.0/pro/image-to-video`	Default — high quality at lower cost
Standard	`kling/kling-3.0/standard/image-to-video`	Concepting, drafts

runcomfy run kling/kling-3.0/pro/image-to-video \
  --input '{
    "image_url": "https://your-cdn.example/character.jpg",
    "prompt": "The character walks toward the camera, soft handheld feel, end on a medium close-up."
  }' \
  --output-dir ./out

Endpoint	When
`minimax/hailuo-2-3/pro/image-to-video` (opens in a new tab) · `/standard/image-to-video` (opens in a new tab)	MiniMax Hailuo — natural motion, strong on real-world subjects
`bytedance/dreamina-3-0/pro/image-to-video` (opens in a new tab)	Dreamina — illustrative / concept art lean
`bytedance/seedance-1-0/pro/fast/image-to-video` (opens in a new tab)	Seedance 1-0 — cheaper baseline
`kling/kling-video-o1/standard` (opens in a new tab)	Kling Video O1 — reasoning-style video model
`kling/kling-2-6/motion-control-pro` (opens in a new tab)	Transfer motion from a reference video onto a target character

code	meaning
0	success
64	bad CLI args
65	bad input JSON / schema mismatch
69	upstream 5xx
75	retryable: timeout / 429
77	not signed in or token rejected