remotion-assemble
Skill132 starsChanged 39 days agoMITView on GitHub
How to use Remotion as the assembly layer - read the project's meta.json and stitch the rendered HyperFrames scenes + footage + voice + sound effects into the finished video. Read this when writing/editing code in engines/remotion or when assembling the timeline for a video.
1 other project uses a version of this, 1 of them edited.
Adopted by
Most recently taken up by
- notivn/AIEVv2edited, first seen Nov 8, 2026
Other versions1 project uses a version of this.
Word for word · 0
None found.
Edited · 1
- notivn/AIEVv2★ 13651% same
Wrote their own version · 0
None found.
How matches are found. Word for word: the exact same text. Edited: shares passages with this file (“99% same” means 99% of its five-word phrases also appear here; 10% or more counts). Their own version: similar meaning, or, weakest, the same name. We can’t tell which project had it first. Projects are counted among the 200 most-starred candidates, and mentions are links to the repository we found, up to 50 per site, so both counts are a floor.
In this repository20 other files it gives its agents.
- CLAUDE.mdCLAUDE.md
- ai-illustrationsSkill
- auto-cutSkill
- background-musicSkill
- color-gradingSkill
- gsapSkill
- hyperframes-cliSkill
- hyperframes-registrySkill
- hyperframesSkill
- key-layoutSkill
- make-a-videoSkill
- noti-tiktok-full-textSkill
- noti-tiktok-vnSkill
- noti-youtube-editSkill
- offline-voiceSkill
- short-form-videoSkill
- skill-authoringSkill
- video-pipelineSkill
- website-to-hyperframesSkill
- webui-designSkill
The file
We split this skill into the rules it gives an agent
3 rules. About 0 are common, 2 are distinctive, and 1 is very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈2
Distinctive · estimate
This author's own choices. Worth a look.
1
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Very specific: line 61
Dimensions/fps come from the manifest: - use calculateMetadata to set width/height/fps/durationInFrames dynamically from the props, never …
- Distinctive: line 80
When a transition has an overlap, subtract that overlap while accumulating - forgetting to subtract leaves a black gap between scenes.
- Distinctive: line 85
Do not normalize/mix manually with FFmpeg after rendering - mix inside Remotion so the draft sounds like the final.
≈ “Common” is an estimate: at least 1 in 5 of the 372,429 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Remotion Assemble - building the timeline from meta.json
In this system Remotion does exactly one thing: assemble the pieces that already exist (scene MP4s rendered by HyperFrames, source footage, voice, sound effects) into the final video. Do not build motion graphics in Remotion - that is HyperFrames' job.
Structure of engines/remotion
engines/remotion/
├── package.json ← remotion, @remotion/cli, @remotion/renderer
├── remotion.config.ts
└── src/
├── Root.tsx ← registers 3 compositions: "Assemble" + "Poster" + "Thumbnail"
├── Assemble.tsx ← master composition: read manifest → build timeline
├── Poster.tsx ← static poster composition (image projects)
├── Thumbnail.tsx ← static video-thumbnail composition (frame card + title)
├── manifest.ts ← load + validate video props (zod)
├── posterManifest.ts ← load + validate poster props (zod)
├── thumbnailManifest.ts ← load + validate thumbnail props (zod)
├── brandFonts.ts ← load brand fonts via staticFile (offline)
├── index.ts ← entry point registering Root
└── components/
├── SceneClip.tsx ← <OffthreadVideo>/<Img> for one scene/footage clip
├── Transition.tsx ← hard cut / crossfade (fade) - only these 2
├── SfxTrack.tsx ← places <Audio> at sfx[].atFrame
├── MusicTrack.tsx ← background music: loop + fade + deterministic ducking
├── CaptionTrack.tsx ← karaoke captions from word timestamps
├── HighlightTrack.tsx ← main/related key bands (key-layout)
└── vietnameseFont.ts ← @font-face Inter vietnamese subsetManifest fields beyond scenes/captions/overlays (see manifest.ts):
watermark- the Style Design corner logo, stamped by the SERVER (jobs/assemble.ts), never by the AI;null= the style has no logo.audio.music- background music{ file, volume, duckVolume, speech: [[startSec,endSec],...] }with deterministic ducking over speech ranges (see thebackground-musicskill);null= no music.scenes[].zoom- camera move on footage{ origin?, keys: [{frame, scale, ease?}] };framecounts from the START OF THE SCENE, applied to the wrapper div (never the video element).audio.sfx[].mediaStart- seconds skipped at the head of the sfx file (lead silence trim, see noti-tiktok-vn "SFX loudness and lead silence").
Core principles
- A single data-driven
Assemblecomposition. Everything comes from the project'smeta.json, passed throughdefaultProps/inputProps. Adding a new video means no Remotion code changes, only a new manifest.
npx remotion render Assemble \
--props="<abs>/video-projects/<name>/props.resolved.json" \
--output="../../outputs/<name>-v1.mp4" \
--concurrency 8 --gl angle⚠️ Asset paths in the props must be
staging/...- the backend stages assets intoengines/remotion/public/staging/via hardlinks and then writesprops.resolved.json. NEVER render straight frommeta.json(its paths are relative to the project folder, and Remotion cannot resolve those throughstaticFile).
--gl angleis MANDATORY on a machine with a GPU - without it Remotion renders with the software renderer, CPU at 100% and GPU at 5%. For drafts add--crf 28 --x264-preset veryfast. (The backend queue adds these flags automatically.)
- Dimensions/fps come from the manifest - use
calculateMetadatato setwidth/height/fps/durationInFramesdynamically from the props, never hardcode them inRoot.tsx. - Embedded video uses
<OffthreadVideo>, not<Video>- it is more stable server-side and lands on the right frame. Whatever fps a HyperFrames scene was rendered at, the manifest must declare that exact fps; an fps mismatch between scene and composition is the number one source of stuttering. - Timeline = accumulating
durationInFrames:
let from = 0;
scenes.map((s) => {
const seq = (
<Sequence key={s.id} from={from} durationInFrames={s.durationInFrames}>
<SceneClip scene={s} />
</Sequence>
);
from += s.durationInFrames - (s.transitionOverlap ?? 0);
return seq;
});When a transition has an overlap, subtract that overlap while accumulating - forgetting to subtract leaves a black gap between scenes.
- Audio:
- Voice: one
<Audio src={voice}>running from frame 0 - the voice is the sync backbone, scenes follow the voice and never the other way round. - Sound effects: each
sfx[]entry becomes one<Sequence from={atFrame}><Audio volume={0.3}/></Sequence>. Default sfx volume is 0.3 (~10dB below the voice); override it in the manifest with thevolumefield if needed. - Do not normalize/mix manually with FFmpeg after rendering - mix inside Remotion so the draft sounds like the final.
- Voice: one
Caption and overlay tracks live in
meta.json, and their timestamps are in FRAMES.CaptionTrackandHighlightTrackreadprops.captions/props.overlaysonly. They never open a transcript file. If you leave those arrays empty there are no captions, no matter how good the transcript is.
// meta.json
"captions": [
{ "from": 90, "durationInFrames": 75,
"words": [ { "text": "Trí", "start": 90, "end": 96 },
{ "text": "tuệ", "start": 96, "end": 104, "hi": true } ] }
],
"overlays": [
{ "from": 0, "durationInFrames": 150, "tier": "main", "accent": "hot",
"kicker": "AI", "parts": [ { "t": "Dựng video" }, { "t": "bằng AI", "hi": true } ] }
]⚠️ The unit changes here. A transcript stores
start/endin seconds;captions[].words[]stores them as absolute composition frames (second * fps, counted from the start of the whole video, not from the start of the cue). Passing seconds through produces captions that all flash in the first half-second — and nothing errors, so it is easy to ship by accident.
hi: truemarks a highlighted word.tier: "main"renders a top band,"sub"a bottom pill that lifts itself when captions are present.
- Every scene needs
durationInFramesunless it is asrcVideoscene with bothfromandto. That is the only case Remotion infers a length for; an image or HyperFrames scene without an explicitdurationInFramesthrows at render time. This bites hardest on videos with no source footage (text-to-video, image-only explainers), where nothing has a natural duration to infer from. - Asset paths: Remotion code only loads through
staticFile()- the backend stages assets intoengines/remotion/public/staging/<project>/(hardlink) and writes thestaging/...path intoprops.resolved.json; Remotion never reads an absolute path. This runs on Windows - always usepath.joinon the backend, never string concatenation.
Draft vs Final
| Draft | Final | |
| Command | --crf 28 --x264-preset veryfast (+ --concurrency 8 --gl angle) | defaults (crf 18) |
| Scene input | renders/*.draft.mp4 | renders/*.mp4 (quality standard) |
| Purpose | review pacing, sync, transitions | publishing |
The backend picks the scene input set based on the job type - the Remotion code does not distinguish draft from final, it only takes the paths from the manifest.
Known issues & how to avoid them
- Stutter/freeze at a scene boundary: the scene fps differs from the composition fps, or
durationInFramesin the manifest does not match the real length of the MP4. Check withffprobe -show_streams <file>before assembling. - Audio drifting out of sync toward the end: a VBR voice mp3 -> convert it to CBR/WAV before putting it in the manifest (
ffmpeg -i voice.mp3 -ar 48000 voice.wav). - Color mismatch between HyperFrames scenes and footage: both engines render through Chromium so they usually match; if they do not, check whether the footage has an unusual color space tag (
bt709is the standard) - transcode the footage to bt709 first. - Render hanging on Windows: usually caused by Vietnamese characters/spaces in an asset file path - name asset files in ASCII kebab-case right from the import step.
- One black frame at every footage cut: a
srcVideoscene sizedround((to-from)*fps)whileOffthreadVideoplaysround(to*fps) - round(from*fps)frames - the two differ by one (from=1.02, to=3.98 @30fps: 89 vs 88). Always round EACH END, never the difference;resolveSceneDurationInFramesandframeOfinjobs/assemble.tsmust stay in lockstep withSceneClip. - Whole render dies on one tiny cue (
inputRange must be strictly monotonically increasing): a fade written as[0, 4, max(5, last-4), last]is not increasing when a cue is 6 frames or less (a translated cue clamped near the end of the video is enough). UsefadeInOut()fromcomponents/fade.tsfor any new track instead of hand-writing the range. - Rendering on a machine with no network: Remotion tries to download Chrome from
remotion.media. Pass--browser-executable=<local chrome/headless_shell>instead.
Remotion license (keep in mind when scaling up)
Remotion is free for individuals and companies of <= 3 people; beyond that you need a Company License. This note is for planning growth - it does not affect the current stage.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

