agentleFS
PrunaAIPrunaAI/pruna-skills/skills/audio/whisperx/SKILL.md

whisperx

Skill20 starsChanged 44 days agoApache-2.0View on GitHub

Use when someone needs word-level timestamps from audio — lyric alignment, cut-safe line boundaries, or caption source timing before burn-in with video-editing.

  • Reads credentials

The file

We split this skill into the rules it gives an agent

3 rules. About 0 are common, 3 are distinctive, and 0 are very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈3

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 0

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Follow each skill's Before generating / craft sections — do not restate guide content here.

    line 23
  2. Distinctive:

    Use a different skill instead:

    line 31
  3. Distinctive:

    Prefer the repo helpers (they upload local audio and write JSON + SRT):

    line 47

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Prerequisites

Install and load these skills before generating (skip if already in context via @pruna):

SkillDescriptionInstall
generation-diversityUse when writing any generative prompt — ritual seed, explicit structure, scenario axes, and quality gates before paid API calls.npx skills add PrunaAI/pruna-skills@generation-diversity -y
pruna-apiUse before any Pruna or Replicate HTTP call — credentials, upload/poll/download, parallel batches, and agent safety.npx skills add PrunaAI/pruna-skills@pruna-api -y

Or install the full suite once: npx skills add PrunaAI/pruna-skills@pruna -y

Follow each skill's Before generating / craft sections — do not restate guide content here.

Agent habit

In the first reply, name `whisperx` in backticks, confirm REPLICATE_API_TOKEN (or stop with signup links from pruna-api), then ask for required inputs. Open intake → generation-diversity clarification intake before the first POST. Redirect when When NOT to use fits better.

When NOT to use

Use a different skill instead:

SkillDescriptionInstall
music-2.5Use when someone wants an original AI song with vocals — sung lyrics, a style prompt track, or source audio for a music video.npx skills add PrunaAI/pruna-skills@music-2.5 -y
gemini-3.1-flash-ttsUse when someone needs spoken narration or voiceover — explainer tracks, documentary lines, or voice to pair with generated video.npx skills add PrunaAI/pruna-skills@gemini-3.1-flash-tts -y
video-editingUse when assembling or polishing already-rendered clips with ffmpeg — concat, crossfades, burned captions and subtitles, text/logo overlays, before/after sliders, background music beds, platform export — or when composing a multi-layer HTML combination video with Hyperframes. Not for AI video generation, prompt craft, or model-based video edits.npx skills add PrunaAI/pruna-skills@video-editing -y

Environment

export REPLICATE_API_TOKEN=r8_...

HTTP / pipeline

Prefer the repo helpers (they upload local audio and write JSON + SRT):

# Agent: follow phase table in this SKILL.md \
  --song output/my-mv/song.mp3 \
  --out output/my-mv/whisperx_transcript.json \
  --initial-prompt "First few lyric lines help recognition"

# Agent: follow phase table in this SKILL.md \
  --cuts output/my-mv/cut_manifest.json \
  --transcript output/my-mv/whisperx_transcript.json \
  --song output/my-mv/song.mp3

In a music-video workflow, run this skill during the align phase — see music-video.

Before generating

  1. Complete Prerequisites guide reading order.
  2. Confirm audio_file (HTTPS URL — helpers upload local files), language, and align_output: true for word-level cut alignment. When listing inputs, name REPLICATE_API_TOKEN (Replicate — not PRUNA_API_KEY).
  3. Model notes: set initial_prompt to the first lyric lines for better rap/sung recognition. Optional diarization for multi-voice battles.

Required input

  • audio_file (HTTPS URL)

Common optional fields

  • language — ISO code, e.g. en
  • align_output — true for word-level timestamps (required for cut alignment)
  • initial_prompt — first lyric lines
  • diarization — speaker labels

Typical next steps

Common follow-ons after this skill:

SkillDescriptionInstall
music-videoUse when someone wants a full music video — original song or vocals, performance clips, B-roll, and lyric-synced edits.npx skills add PrunaAI/pruna-skills@music-video -y
music-2.5Use when someone wants an original AI song with vocals — sung lyrics, a style prompt track, or source audio for a music video.npx skills add PrunaAI/pruna-skills@music-2.5 -y
video-editingUse when assembling or polishing already-rendered clips with ffmpeg — concat, crossfades, burned captions and subtitles, text/logo overlays, before/after sliders, background music beds, platform export — or when composing a multi-layer HTML combination video with Hyperframes. Not for AI video generation, prompt craft, or model-based video edits.npx skills add PrunaAI/pruna-skills@video-editing -y

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.