storyboard-av-mix
Skill210 starsChanged 2 days agoMITView on GitHub
Muxes per-shot storyboard video with Chinese and English voice-over by retiming video to match VO duration (setpts), writing Video-Chinese/ and Video-English/ (matched by shot id 01, 02, …). Use when the user wants storyboard A/V mix, VO dubbing mix, video retime to audio, Video-Chinese, Video-English, bilingual VO on cut video, or batch mux Video/ + Chinese/ + English/.
1 other project uses a version of this.
Adopted by
Most recently taken up by
- godot-fun/godot-agentword for word, first seen Nov 15, 2026
Other versions1 project uses a version of this.
Word for word · 1
- godot-fun/godot-agent★ 210100% same
Edited · 0
None found.
Wrote their own version · 0
None found.
How matches are found. Word for word: the exact same text. Edited: shares passages with this file (“99% same” means 99% of its five-word phrases also appear here; 10% or more counts). Their own version: similar meaning, or, weakest, the same name. We can’t tell which project had it first. Projects are counted among the 200 most-starred candidates, and mentions are links to the repository we found, up to 50 per site, so both counts are a floor.
In this repository40 other files it gives its agents.
- AGENTS.mdAGENTS.md
- .agents/skills/AGENTS.mdAGENTS.md
- ai-text-to-speechSkill
- audio-denoiseSkill
- audio-fadeSkill
- audio-loudness-normalizationSkill
- audio-sample-rate-standardizeSkill
- audio-splitSkill
- audio-to-oggSkill
- audio-to-textSkill
- audio-to-wavSkill
- audio-trimSkill
- audio-volume-adjustSkill
- file-naming-normalizationSkill
- git-commit-messageSkill
- image-inpaint-regionSkill
- image-region-remove-key-color-appSkill
- image-remove-backgroundSkill
- image-remove-white-backgroundSkill
- image-resizeSkill
- image-sprite-sheet-splitSkill
- image-to-pngSkill
- image-to-textSkill
- image-trimSkill
- storyboard-shot-to-htmlSkill
- storyboardSkill
- storyboard-ttsSkill
- video-4k-normalizationSkill
- video-bgmSkill
- video-compress-to-sizeSkill
- video-cutSkill
- video-merge-gpuSkill
- video-mergeSkill
- video-publishSkill
- video-remove-audioSkill
- video-to-4kSkill
- video-to-60fpsSkill
- video-to-mp4Skill
- video-to-ogvSkill
- video-to-wavSkill
The file
We split this skill into the rules it gives an agent
7 rules. About 0 are common, 2 are distinctive, and 5 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈2
Distinctive · estimate
This author's own choices. Worth a look.
5
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Very specific: line 34
When this skill applies, read and follow dependency-manager — run scripts as documented, install missing tools into .dependency/.
- Very specific: line 36
VO timing is immutable: Never stretch, shrink, pad, trim, or atempo the voice-over.
- Very specific: line 37
Video serves audio: Only change video duration (FFmpeg setpts) so it equals that shot’s VO length, then mux.
- Very specific: line 43
Never overwrite inputs under the clip dir, Chinese/, or English/.
- Very specific: line 100
Prefer one mix.py run for the whole board.
- Distinctive: line 101
Ask for both paths before running — the script has no fallback and will stop without them.
- Distinctive: line 102
Verify the reported output profile for high-bit-depth/HDR sources.
≈ “Common” is an estimate: at least 1 in 5 of the 372,429 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Storyboard AV Mix
Take an audio dir with bilingual VO plus a clip dir with per-shot video. For each shot, retime the video to the full VO duration (audio master), drop original video audio, mux, and write language-specific folders next to the VO.
Two paths drive every run — pass them explicitly:
mix.py --audio path/to/<vo-dir> --video path/to/Video| Input | Path |
| Chinese VO | <audio>/Chinese/<shot-id>.* |
| English VO | <audio>/English/<shot-id>.* |
| Shot video | <video>/<shot-id>.* |
| Output | Path |
| Chinese mux | <audio>/Video-Chinese/<shot-id>.<video-ext> |
| English mux | <audio>/Video-English/<shot-id>.<video-ext> |
Rules
When this skill applies, read and follow dependency-manager — run scripts as documented, install missing tools into .dependency/.
- VO timing is immutable. Never stretch, shrink, pad, trim, or
atempothe voice-over. Duration of the VO file is the master clock. - Video serves audio. Only change video duration (FFmpeg
setpts) so it equals that shot’s VO length, then mux. - Drop all audio from the source video; replace with the VO track. Prefer
-c:a copy; if the container cannot hold the VO codec (e.g. WAV→MP4), encode AAC without changing length. - Preserve source quality characteristics.
setptsrequires a re-encode. The bundled script keeps HEVC/10-bit sources in H.265 Main10, preserves sourcepix_fmt, bitrate when known, color tags, and supported HDR metadata (mastering display / MaxCLL); other sources currently encode with H.264 while retaining their reported pixel format and color tags. Copy available container and video-stream metadata from the source clip. - Match shots by filename stem (
01.mp4↔01.wav). - Two required paths, no guessing.
--audiois the VO dir (Chinese/+English/);--videois the clip dir. Both must be passed — there is no positional path and no auto-detection. Outputs always stay under<audio>/. - Batch only via
.ai/storyboard-av-mix/mix.py— do not hand-write FFmpeg mux/retime commands. - Never overwrite inputs under the clip dir,
Chinese/, orEnglish/.
Quick Start
From project root:
.dependency/python/python .ai/storyboard-av-mix/mix.py --audio path/to/<vo-dir> --video path/to/VideoSingle language:
.dependency/python/python .ai/storyboard-av-mix/mix.py --audio path/to/<vo-dir> --video path/to/Video --lang chinesePer shot / language the script:
- Validates both required dirs (
--audio,--video) - Probes VO duration (source of truth) and video duration
- Applies
setpts=PTS*(vo_dur/video_dur)— stretch or compress video only (plus short freeze-tail so video ≥ VO) - Muxes with
-shortestso the output follows the VO clock (minor frame/container rounding may remain) - Writes
<audio>/Video-Chinese|orVideo-English//<shot-id>.<same-ext>
Layout
workspace/
Video/ # clip dir (--video)
01.mp4
02.mp4
vo/ # audio dir (--audio)
Chinese/01.wav
English/01.wav
Video-Chinese/ # written by this skill
01.mp4
02.mp4
Video-English/
01.mp4
02.mp4The clip dir may live inside the audio dir (vo/Video/) or outside it (workspace/Video/) — either way --video must name the folder that holds 01.mp4, 02.mp4, …. Typical <audio> is a storyboard-tts output dir; nothing is inferred from the tree.
Common Flags
| Flag | Notes |
--audio | Required. VO work dir with Chinese/ and English/ |
--video | Required. Clip dir with 01.mp4, 02.mp4, … |
--lang | both (default), chinese, english |
Existing outputs are overwritten. Missing VO for a language → skip that job with a warning. A shot without a matching VO file is skipped. Missing flag → argparse error; a flag pointing at a missing dir → Audio dir not found / Video dir not found, exit code 1.
Agent Notes
- Audio first: if durations disagree, change video, never VO.
- Prefer one
mix.pyrun for the whole board. - Ask for both paths before running — the script has no fallback and will stop without them.
- Verify the reported output profile for high-bit-depth/HDR sources; the script must not force those sources to 8-bit H.264.
- Chat summary: resolved audio dir + clip dir, jobs done / skipped, paths to
Video-Chinese/andVideo-English/. - Upstream VO usually from storyboard-tts; this skill does not synthesize speech.
- Missing Python/FFmpeg → populate
.dependency/per dependency-manager, retry same command.
Tests
From repo root:
.dependency/python/python .ai/storyboard-av-mix/test_mix.pyRelated
- storyboard-tts — bilingual VO under
Chinese//English/ - storyboard — source markdown
Manual CLI examples: cli/storyboard-av-mix.md
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

