Subchapter 29.1
references/frame-skeleton.mdMarkdown6 KBView on GitHub
At Step 2 you (the orchestrator) read audiomap.json and write the skeleton of
STORYBOARD.md directly: cut the track into frames (one frame = one composition file =
one scene), and for each frame set its , its (does this stretch want hard
beat-cuts, or calm phrase/energy flow?), its , and a one-line note.
You classify and lay out the spine only. You do not pick templates, write copy, choose
colors/fonts, or decide a frame’s groups — those are Step 3 (the plan fills each frame in
place). Leave every frame’s ### Groups as TBD (Step 3) and the frontmatter style blank.
There is no intermediate JSON — the skeleton is the start of STORYBOARD.md. Step 3
edits the same file.
audiomap.json is one analyzer’s output. Some fields are robust on any music; some are
reliable only when the music is actually rhythmic. This decides each frame’s pacing:
| Field | Trust |
|---|---|
energy_phases[] (level / energy / density / feel), events[] + onset_rate, rolls[] (and their absence), silences[], hard_stops[], key_moments[], phrases[], audio.duration_sec | Always — robust measurements |
tempo.bpm, grid.beats_sec / downbeats_sec precision | Only when the music is rhythmic. On calm / sparse material the beat grid is a metronome the tracker imposes (often octave-doubled) — usually more grid beats than real onsets. Do not anchor cuts to it there. |
onset_rate with a steady grid.rolls≈0, mostly sparse phases, low onset_rate → pace by phrases[] + energy_phases[], not beats.summary / tempo / audio.duration_sec + the roll count, write the
frontmatter compositionId, duration_s (== audio.duration_sec), canvas, and a
one-line read of the track’s density arc.energy_phases[] and split where the music genuinely changes
state — at hard_stops[], SURGE / DROP key_moments, the start/end of a rolls[] run,
an onset desert (a long gap in events[]), or a big energy-level jump. Collapse adjacent
phases that are one gesture. Expect ~1–6 frames; a short clip may be one.
Snap every boundary to an audiomap anchor, then re-snap to the nearest beats_sec
(tolerance ≤ ½ beat) only when the grid is reliable; on calm material snap to
phrases[] / energy_phases[] edges instead. Frames tile the track (first at 0, last
at duration_s, no gaps/overlaps).pacing — the trust-boundary call:
beat_cut — genuinely rhythmic: a roll present, or dense, or (clearly high onset_rate and a steady grid). Hard cuts / per-onset reveals may anchor to beats.phrase_flow — calm / sparse: rolls≈0, mostly sparse, low onset_rate. Do not anchor hard cuts to the grid; pace by phrases[] + the energy envelope (slow crossfades, long holds).mood (1–3 of: warm · dark · hype · elegant · glitch ·
cinematic · playful · tense · dreamy · aggressive) from energy_phases[].feel +
energy + any genre cue in the brief/title.feel — the plain-language music situation Step 3 matches a
template against (e.g. “accelerating onset stream into a held downbeat”, “calm held pad, one
onset desert”, “fast sustained-fill roll, no readable message”). This is what the planner
reads against the catalog’s Reach for it when — keep it concrete, drawn from the robust
fields, never invented.A valid STORYBOARD.md with the spine set and every frame’s treatment left for Step 3
(full syntax in storyboard-format.md):
---
compositionId: bgm
duration_s: 30.0 # == audiomap.audio.duration_sec
canvas: { w: 1920, h: 1080, fps: 30 }
style: # blank — Step 3 fills it from the chosen frame.md preset
build_notes: ["one paused timeline per frame", "no remote assets"]
---
## Frame 1 — f1
- src: compositions/frames/01-f1.html
- duration: 7.198s # = span length; assembler sums these for cumulative data-start
- span_sec: [0.0, 7.198] # track seconds; frames tile the track
- pacing: beat_cut
- mood: [hype]
- feel: accelerating onset stream building into a held downbeat
### Groups
- TBD (Step 3)
## Frame 2 — f2
- src: compositions/frames/02-f2.html
- duration: 10.4s
- span_sec: [7.198, 17.598]
- pacing: phrase_flow
- mood: [warm, cinematic]
- feel: calm held pad, one long onset desert
### Groups
- TBD (Step 3)duration_s == audiomap.audio.duration_sec; frames tile the track gap-free (first at 0, last at duration_s).src + span_sec + duration + pacing + mood + a one-line feel.pacing was set from the robust fields (energy / density / rolls / onset_rate), never from bpm / beats_sec alone.rolls[] run or leaves a sub-1-bar fragment.### Groups is TBD (Step 3); style is blank. No template, copy, color, or font anywhere.