Setting the skill. One moment.
34 skills · 155 min
Skills
Skill 20 of 34
Lip-sync a face to a specific audio track on RunComfy via the runcomfy CLI.
5 minutes · 1,043 words · 25 sections
Install
npx skills add runcomfy-com/skills --skill lipsyncnpx skills add runcomfy-com/skills/plugin marketplace add runcomfy-com/skillsThe first command installs just this skill, by the name in its SKILL.md; the second installs the whole repository.
Drive a face’s mouth from an audio track. This skill routes across the lip-sync endpoints in the RunComfy catalog — OmniHuman, Sync Labs sync v2, Kling lipsync, Creatify — picking the right model for the user’s actual intent and shipping the documented prompts + the exact runcomfy run invoke.
runcomfy.com (opens in a new tab) · Sync Labs models (opens in a new tab) · CLI docs (opens in a new tab)
Lip-sync a face to a specific audio track on RunComfy via the `runcomfy` CLI. Routes across ByteDance OmniHuman (audio-driven full-body avatar from a portrait + audio), Sync Labs sync v2 / Pro (state-of-the-art mouth sync onto a video), Kling lipsync (audio-to- video and text-to-video with synced speech), and Creatify lipsync. The skill picks the right endpoint for the user's actual intent — portrait still + audio (avatar-style), source video + audio (mouth- swap on existing footage), or generate-and-sync from a script. Triggers on "lip sync", "lipsync", "make this video speak", "match audio to mouth", "dub video", "sync lips to voice", "Sync Labs", "voiceover sync", or any explicit ask to drive a face's mouth from an audio track.
The verbatim description from this skill’s front matter — the string an agent matches on to decide whether to load it.
Bash(runcomfy*)lipsync/SKILL.mdmain, last pushed 15 September 2026.SKILL.md, not by matching a directory convention. 2 distinct layouts observed: */SKILL.md, plugins/runcomfy/skills/*/SKILL.md.h1 and no skipped levels:.claude-plugin/marketplace.json by RunComfy, declaring 1 plugin. It is read for editorial metadata only — never as the skill index, which is always the repository tree.# 1. Install (see runcomfy-cli skill for details)
npm i -g @runcomfy/cli # or: npx -y @runcomfy/cli --version
# 2. Sign in
runcomfy login # or in CI: export RUNCOMFY_TOKEN=<token>
# 3. Lipsync
runcomfy run <vendor>/<model> \
--input '{"video_url": "...", "audio_url": "..."}' \
--output-dir ./outCLI deep dive: runcomfy-cli (opens in a new tab) skill.
Driving a real person’s mouth from a separate audio track is dual-use. Refuse user requests that target real public figures without consent, or that aim at defamatory or sexually explicit synthetic media. The skill itself does not gate inputs — the responsibility rests with the operator.
Listed newest first within each subtype. The agent picks one route based on: input shape (portrait still + audio vs source video + audio vs script-only), quality tier, and budget.
Sync Labs sync v2 Pro — sync/sync/lipsync/v2/pro (default for premium)
Sync Labs’ premium lip-sync — state-of-the-art mouth motion onto an existing video. Preserves the rest of the frame untouched. Pick for: hero-quality dubs, lipsync on professionally-shot video, foreign-language dubbing where mouth fidelity matters most. Avoid for: cost-sensitive batch jobs — drop to sync v2.
Sync Labs sync v2 — sync/sync/lipsync/v2 (opens in a new tab)
Standard Sync Labs tier, same workflow as Pro. Pick for: scaled / batch lipsync jobs, drafts. Avoid for: hero delivery — use v2 Pro.
Kling Lipsync (audio-to-video) — kling/lipsync/audio-to-video (opens in a new tab)
Kling’s lip-sync onto a source video, driven by an audio track. Pick for: Kling-pipeline integration; alternative to Sync Labs. Avoid for: top-tier mouth fidelity — Sync Labs Pro is the industry benchmark.
Creatify Lipsync — creatify/lipsync (opens in a new tab)
Creatify’s lipsync endpoint. Pick for: Creatify-ecosystem workflows. Avoid for: comparison shopping unless cost / latency favors it.
OmniHuman — bytedance/omnihuman/api (default for avatar-style)
ByteDance’s audio-driven full-body avatar. One portrait + one audio → video where the subject speaks / gestures naturally. Listed under RunComfy’s
/feature/lip-syncas the curated default. Pick for: UGC voiceover, virtual presenter, dubbed product demo from a single portrait. Avoid for: lip-sync onto an existing video (no portrait, want to preserve original motion) — use Sync Labs v2 instead.
Wan 2-7 with audio_url — wan-ai/wan-2-7/text-to-video
Open-weights t2v with
audio_urlfield — prompt describes the scene, audio drives the mouth. Pick for: full scene control (not just a portrait) with a specific voiceover MP3 + open-weights pipeline. Avoid for: simplest “portrait talks” — use OmniHuman.
Kling Lipsync (text-to-video) — kling/lipsync/text-to-video (opens in a new tab)
Generates speech audio in-pass from a script and syncs it to the resulting video. Pick for: “write a script → get a video with synced speech”, no audio file needed. Avoid for: precise lip-sync to a specific MP3 (audio is regenerated each call, not locked).
HappyHorse 1.0 — happyhorse/happyhorse-1-0/text-to-video (also /image-to-video)
Arena #1 t2v / i2v with in-pass audio generated from prompt. Quote the spoken line inside the prompt with
says clearly: "…". Pick for: written script, in-pass audio with strong overall quality, social/UGC clips. Avoid for: locking mouth to a pre-recorded voiceover.
Model: sync/sync/lipsync/v2/pro (or sync/sync/lipsync/v2)
Catalog: sync v2 Pro (opens in a new tab) · sync v2 (opens in a new tab)
runcomfy run sync/sync/lipsync/v2/pro \
--input '{
"video_url": "https://your-cdn.example/source-video.mp4",
"audio_url": "https://your-cdn.example/voiceover.mp3"
}' \
--output-dir ./outModel: bytedance/omnihuman/api
Catalog: omnihuman (opens in a new tab)
runcomfy run bytedance/omnihuman/api \
--input '{
"image_url": "https://your-cdn.example/portrait.jpg",
"audio_url": "https://your-cdn.example/voiceover.mp3"
}' \
--output-dir ./outai-avatar-video (opens in a new tab) skill for the full avatar treatment.Model: kling/lipsync/audio-to-video (existing video + audio) or kling/lipsync/text-to-video (script-only)
Catalog: Kling lipsync a2v (opens in a new tab) · Kling lipsync t2v (opens in a new tab)
runcomfy run kling/lipsync/audio-to-video \
--input '{
"video_url": "https://your-cdn.example/source-video.mp4",
"audio_url": "https://your-cdn.example/voiceover.mp3"
}' \
--output-dir ./outSchema details on the model page.
community/wan-2-2-animate/video-to-video) — see ai-avatar-video (opens in a new tab).kling collection (opens in a new tab) — including Kling lipsync variants| code | meaning |
|---|---|
| 0 | success |
| 64 | bad CLI args |
| 65 | bad input JSON / schema mismatch |
| 69 | upstream 5xx |
| 75 | retryable: timeout / 429 |
| 77 | not signed in or token rejected |
Full reference: docs.runcomfy.com/cli/troubleshooting (opens in a new tab).
The skill classifies user intent — source video + audio? portrait still + audio? script only? — picks the matching route, and invokes runcomfy run with the JSON body. The CLI POSTs to the Model API, polls request status, fetches the result, and downloads any .runcomfy.net / .runcomfy.com URLs into --output-dir.
npm i -g @runcomfy/cli or npx -y @runcomfy/cli. Agents must not pipe an arbitrary remote install script into a shell on the user’s behalf.runcomfy login writes the API token to ~/.config/runcomfy/token.json with mode 0600. Set RUNCOMFY_TOKEN env var in CI / containers.--input. The CLI does not shell-expand prompt content. No shell-injection surface.model-api.runcomfy.net and *.runcomfy.net / *.runcomfy.com. No telemetry.Bash(runcomfy *) only.runcomfy-cli (opens in a new tab) — the underlying CLIai-avatar-video (opens in a new tab) — full avatar / talking-head router (OmniHuman + HappyHorse + Wan)ai-video-generation (opens in a new tab) — general t2v / i2vface-swap (opens in a new tab) — identity swap on existing video (often paired with lipsync)video-edit (opens in a new tab) — broader video edit/runcomfy-com/skills.md, and each skill at its own .md URL.