design-audio-visualizations
Skill51k starsChanged 2 days agoMITView on GitHub
Design and build AIRI visuals that react to audio, for example a microphone check, a voice wave, a level meter, or a speaking glow. Use when UI motion follows a microphone or a playback, or when such a visual flickers, lags, or feels stiff.
Adopted by
Steady: 0 new projects took it in the last 4 weeks, none the 4 weeks before.thin data
Who's talking about moeru-ai/airi
- Ian Li“Project AIRI - AI waifu / virtual characters”YouTube · Sep 7, 2025 · 30k views
- Github Updates“Airi Self hosted you owned Grok Companion (All You need to Know)”YouTube · Mar 7, 2026 · 9.5k views
- Skillmdpro“Project AIRI - Open Source AI VTuber That Plays Games (Neuro-sama Alternative)”YouTube · Mar 28, 2026 · 8.4k views
- GitHub Daily Trend AI Podcast“GitHub - moeru-ai/airi: 💖🧸 Self hosted, you owned Grok Companion, a container of souls of waifu...”YouTube · Aug 21, 2025 · 7k views
- Alex Hitt“Airi GitHub Overview: From Browser Chat Limits to a Self-Hosted Avatar Engine”YouTube · Jul 29, 2026 · 2.3k views
The biggest 5 of 96 mentions linking to the repository that our crawl found. Each line is their own headline.
See all 96
Talked about on GitHub, Bluesky, YouTube, Hacker News and the web (96 times).
On GitHub · 50
- May 9, 2026fix: correctly clean request body — moeru-ai/xsai2 reactions
- Nov 9, 2025Railway self-deployment issues — groupultra/telegram-search2 reactions
- Jun 22, 2026Integrate shared voice input session into desktop stage — Neko-233/airi1 reaction
- Apr 1, 2026test(node): add regression test for `EADDRINUSE` handling — h3js/crossws1 reaction · 2 comments
- Jun 27, 2025airi: init at 0.7.0 — NixOS/nixpkgs1 reaction · 4 comments
45 more on GitHub
- Nov 13, 2026agent-skills.github.moeru-ai.airi: 0.15.2 → 0.15.4 — sudosubin/agents.nix0 reactions
- Nov 9, 2026agent-skills.github.moeru-ai.airi: 0.15.1 → 0.15.2 — sudosubin/agents.nix0 reactions
- Nov 7, 2026Port AIRI Android capabilities into native NEXUS — mechy007/Nexus0 reactions
- Nov 4, 2026agent-skills.github.moeru-ai.airi: 0.15.0 → 0.15.1 — sudosubin/agents.nix0 reactions
- Nov 4, 2026agent-skills.github.moeru-ai.airi: 0.14.1 → 0.15.0 — sudosubin/agents.nix0 reactions
- Nov 1, 2026fix(deps): update dependency @proj-airi/ui to v0.14.1 — nekomeowww/iconify-inspector0 reactions · 1 comment
- Oct 30, 2026agent-skills.github.moeru-ai.airi: 0.14.0 → 0.14.1 — sudosubin/agents.nix0 reactions
- Oct 30, 2026agent-skills.github.moeru-ai.airi: 0.13.1 → 0.14.0 — sudosubin/agents.nix0 reactions
- Oct 29, 2026agent-skills.github.moeru-ai.airi: 0.13.0 → 0.13.1 — sudosubin/agents.nix0 reactions
- Oct 27, 2026agent-skills.github.moeru-ai.airi: 0.12.0 → 0.13.0 — sudosubin/agents.nix0 reactions
- Oct 23, 2026agent-skills.github.moeru-ai.airi: 0.11.3 → 0.12.0 — sudosubin/agents.nix0 reactions
- Oct 13, 2026fix(stage-tamagotchi): follow the cursor from DOM pointer events on Wayland — Somme4096/airi-tiny0 reactions
- Oct 11, 2026[下一版讨论] 参考 AIRI 增强角色演出:表情动作、口型与语音时序 — SlimeBoyOwO/LingChat0 reactions · 2 comments
- Oct 9, 2026最初の縦切り: 根拠付き履歴から一晩の反省会を再生できる居酒屋デモを作る — ryoryo34/agent-izakaya0 reactions
- Oct 9, 2026[Candidate] moeru-ai/airi/.agents/skills/agent-browser - agent-browser — ProSkillsMD/proskills0 reactions · 1 comment
- Oct 5, 2026Staleness report — csells/awesome-jarvis0 reactions · 5 comments
- Sep 30, 2026agent-skills.github.moeru-ai.airi: init at 0.11.3 — sudosubin/agents.nix0 reactions
- Sep 23, 2026feat(stage-ui): add cloud sync switches for providers and chats — lulu0119/airi0 reactions · 1 comment
- Sep 21, 2026`github-agents-or-bots` does not work on some pages of `apache/shardingsphere` — luoling8192/github-automated-contributors0 reactions · 2 comments
- Sep 19, 2026fix(electron): isolate IPC for bound window contexts — moeru-ai/eventa0 reactions
- Sep 5, 2026fix: verify airi clone pin after checkout — davins56/Anima-Protocol0 reactions · 7 comments
- Aug 28, 2026チャットをもっと楽しくしたい — omohikane/saku0 reactions · 2 comments
- Aug 4, 2026feat(cubism2): add verified Core provisioning for Vite — proj-airi/unplugin-live2d-sdk0 reactions
- Aug 4, 2026chore(deps): bump the production-dependencies group across 1 directory with 6 updates — bryce-seefieldt/portfolio-app0 reactions · 1 comment
- Jul 29, 2026🔥 GitHub Trending AI 早报 · 2026-07-30 · Top 6 项目 — happydog-intj/ai-xiaohongshu-daily0 reactions
- Jul 29, 2026🔥 GitHub Trending AI 早报 · 2026-07-30 · Top 6 项目 — Mystery406/ai-xiaohongshu-daily0 reactions
- Jul 29, 2026🔥 GitHub Trending AI 晚报 · 2026-07-29 · Top 6 项目 — Mystery406/ai-xiaohongshu-daily0 reactions
- Jul 29, 2026🔥 GitHub Trending AI 晚报 · 2026-07-29 · Top 6 项目 — happydog-intj/ai-xiaohongshu-daily0 reactions
- Jul 29, 2026Github trending [moeru-ai/airi] 开源AI虚拟角色容器 — web1992/github-trending0 reactions
- Jul 28, 2026🔥 GitHub Trending AI 早报 · 2026-07-29 · Top 6 项目 — happydog-intj/ai-xiaohongshu-daily0 reactions
- Jul 28, 2026🔥 GitHub Trending AI 早报 · 2026-07-29 · Top 6 项目 — Mystery406/ai-xiaohongshu-daily0 reactions
- Jul 28, 2026🔥 GitHub Trending AI 晚报 · 2026-07-28 · Top 6 项目 — Mystery406/ai-xiaohongshu-daily0 reactions
- Jul 28, 2026🔥 GitHub Trending AI 晚报 · 2026-07-28 · Top 6 项目 — happydog-intj/ai-xiaohongshu-daily0 reactions
- Jul 28, 2026Github trending [moeru-ai/airi] AI虚拟伴侣开源灵魂容器 — web1992/github-trending0 reactions
- Jul 27, 2026🔥 GitHub Trending AI 早报 · 2026-07-28 · Top 3 项目 — happydog-intj/ai-xiaohongshu-daily0 reactions
- Jul 27, 2026🔥 GitHub Trending AI 早报 · 2026-07-28 · Top 3 项目 — Mystery406/ai-xiaohongshu-daily0 reactions
- Jul 27, 2026🔥 GitHub Trending AI 晚报 · 2026-07-27 · Top 4 项目 — Mystery406/ai-xiaohongshu-daily0 reactions
- Jul 27, 2026🔥 GitHub Trending AI 晚报 · 2026-07-27 · Top 4 项目 — happydog-intj/ai-xiaohongshu-daily0 reactions
- Jul 22, 2026chore(deps): bump the production-dependencies group with 5 updates — bryce-seefieldt/portfolio-app0 reactions · 2 comments
- Jul 19, 2026fix(deps): update dependency @proj-airi/ui to v0.11.3 — nekomeowww/iconify-inspector0 reactions · 1 comment
- Jul 16, 2026GitHub trending [moeru-ai/airi] 开源复现Neuro-sama — web1992/github-trending0 reactions
- Jul 15, 2026🔥 GitHub Trending AI 早报 · 2026-07-16 · Top 8 项目 — happydog-intj/ai-xiaohongshu-daily0 reactions
- Jul 15, 2026🔥 GitHub Trending AI 早报 · 2026-07-16 · Top 8 项目 — Mystery406/ai-xiaohongshu-daily0 reactions
- Jul 15, 2026🔥 GitHub Trending AI 晚报 · 2026-07-15 · Top 8 项目 — Mystery406/ai-xiaohongshu-daily0 reactions
- Jul 15, 2026🔥 GitHub Trending AI 晚报 · 2026-07-15 · Top 8 项目 — happydog-intj/ai-xiaohongshu-daily0 reactions
On Bluesky · 32
- Feb 26, 2026I love how one of the devs literally has a trans flag pfp github.com/moeru-ai/airi — @claire.on-her.computer11 likes and reposts · 3 replies
- Jul 18, 2026🚀 Skyrocketing! 🚀 (200+ new stars) 📦 moeru-ai / airi ⭐ 42,791 (+402) 🗒 TypeScript 💖🧸 Self hosted, you-owned Grok Companion, a… — @github-trending-js.bsky.social5 likes and reposts · 1 reply
- Jul 31, 2026🚀 Skyrocketing! 🚀 (200+ new stars) 📦 moeru-ai / airi ⭐ 46,117 (+372) 🗒 TypeScript 💖🧸 Self hosted, you-owned Grok Companion, a… — @github-trending-js.bsky.social2 likes and reposts · 1 reply
- Jul 27, 2026今日のGitHubトレンド moeru-ai/airi Project AIRIは、Neuro-samaに触発され、AIワイフやバーチャルキャラクターを現実世界に具現化するための器を再現するプロジェクトです。… — @dailygithubtrends.bsky.social2 likes and reposts
- Jul 13, 2026📦 moeru-ai / airi ⭐ 41,668 (+57) 🗒 TypeScript 💖🧸 Self hosted, you-owned Grok Companion, a container of souls of waifu, cyber livings to… — @github-trending-js.bsky.social2 likes and reposts
27 more on Bluesky
- May 31, 2026セルフホスト可能なLLMベースのバーチャルキャラクター。LLMはクラウドサービスもローカルLLMも各種サポート。 — @matsuu.bsky.social2 likes and reposts
- Apr 8, 2026🚀 Skyrocketing! 🚀 (200+ new stars) 📦 moeru-ai / airi ⭐ 37,443 (+255) 🗒 TypeScript 💖🧸 Self hosted, you-owned Grok Companion, a… — @github-trending-js.bsky.social2 likes and reposts · 1 reply
- Mar 8, 2026This is Japan. — @halka.jp2 likes and reposts
- Mar 3, 2026🎉 Celebrating! 🎉 (500+ new stars) 📦 moeru-ai / airi ⭐ 21,939 (+842) 🗒 TypeScript 💖🧸 Self hosted, you-owned Grok Companion, a… — @github-trending.bsky.social2 likes and reposts · 1 reply
- Oct 26, 2026📦 moeru-ai / airi ⭐ 50,703 (+59) 🗒 TypeScript 💖🧸 Self hosted, you-owned Grok Companion, a container of souls of waifu, cyber livings to… — @github-trending-js.bsky.social1 likes and repost
- Sep 19, 2026🚀 GitHub Intelligence Drop CLI-Anything (Python • 🟢) ⭐ 49.6K → https://github.com/HKUDS/CLI-Anything airi (TypeScript • 🟢) ⭐ 49.3K →… — @githubfeed.bsky.social1 likes and repost
- Aug 23, 2026📦 moeru-ai / airi ⭐ 48,262 (+49) 🗒 TypeScript 💖🧸 Self hosted, you-owned Grok Companion, a container of souls of waifu, cyber livings to… — @github-trending-js.bsky.social1 likes and repost
- Aug 12, 2026Ninguém até hoje ter feito um desses assistentes de IA usando homens bara é sexismo, don't @ me github.com/moeru-ai/airi — @phalkmin.me1 likes and repost
- Jul 28, 2026🎉 Celebrating! 🎉 (500+ new stars) 📦 moeru-ai / airi ⭐ 43,710 (+554) 🗒 TypeScript 💖🧸 Self hosted, you-owned Grok Companion, a… — @github-trending-js.bsky.social1 likes and repost · 1 reply
- Jun 8, 2026📦 moeru-ai / airi ⭐ 40,816 (+43) 🗒 TypeScript 💖🧸 Self hosted, you-owned Grok Companion, a container of souls of waifu, cyber livings to… — @github-trending-js.bsky.social1 likes and repost
- Jun 8, 2026真面目にいうと、これにらいかちゃのモデル使ったらいい感じ動いてくれそう github.com/moeru-ai/airi — @lokxii.bsky.social1 likes and repost · 1 reply
- May 25, 2026📦 moeru-ai / airi ⭐ 39,555 (+32) 🗒 TypeScript 💖🧸 Self hosted, you-owned Grok Companion, a container of souls of waifu, cyber livings to… — @github-trending.bsky.social1 likes and repost
- Mar 29, 2026🚀 Skyrocketing! 🚀 (200+ new stars) 📦 moeru-ai / airi ⭐ 36,176 (+213) 🗒 TypeScript 💖🧸 Self hosted, you-owned Grok Companion, a… — @github-trending.bsky.social1 likes and repost · 1 reply
- Mar 29, 2026🚀 Skyrocketing! 🚀 (200+ new stars) 📦 moeru-ai / airi ⭐ 36,176 (+213) 🗒 TypeScript 💖🧸 Self hosted, you-owned Grok Companion, a… — @github-trending-js.bsky.social1 likes and repost · 1 reply
- Mar 7, 2026💎 Hidden Gem! 💎 (1000+ new stars) 📦 moeru-ai / airi ⭐ 30,357 (+1,362) 🗒 TypeScript 💖🧸 Self hosted, you-owned Grok Companion, a… — @github-trending-js.bsky.social1 likes and repost · 1 reply
- Feb 27, 2026🚀 Skyrocketing! 🚀 (200+ new stars) 📦 moeru-ai / airi ⭐ 17,889 (+229) 🗒 TypeScript 💖🧸 Self hosted, you-owned Grok Companion, a… — @github-trending.bsky.social1 likes and repost · 1 reply
- Feb 27, 2026🚀 Skyrocketing! 🚀 (200+ new stars) 📦 moeru-ai / airi ⭐ 17,889 (+229) 🗒 TypeScript 💖🧸 Self hosted, you-owned Grok Companion, a… — @github-trending-js.bsky.social1 likes and repost · 1 reply
- Feb 10, 2026found this today: github.com/moeru-ai/airi - 17k stars, open source Neuro-sama recreation. self-hosted AI VTuber that plays Minecraft AND… — @viridian.vampuppy.systems1 likes and repost
- Oct 31, 2025github.com/moeru-ai/airi — @heimusu.bsky.social1 likes and repost
- Aug 24, 2025今日のGitHubトレンド moeru-ai/airi このリポジトリは「Project AIRI」として、AIバーチャルキャラクター「Neuro-sama」の再構築を目的としています。… — @dailygithubtrends.bsky.social1 likes and repost
- Aug 21, 2025「AIRI」は、Web技術を多用してAIキャラクターを開発するプロジェクトらしい。ゲームプレイや会話も可能なAIを、ブラウザやデスクトップで動かせるのが特徴で、VTuberのような存在を誰でも手軽に作れる可能性があるかもしれない。 yug1224 starred… — @yug1224.com1 likes and repost
- Aug 20, 2025🚀 Skyrocketing! 🚀 (200+ new stars) 📦 moeru-ai / airi ⭐ 3,123 (+387) 🗒 Vue 💖🧸 Self hosted, you owned Grok Companion, a container of… — @github-trending.bsky.social1 likes and repost
- Jul 15, 2025Show HN: Recreation of Neuro-sama for a year, alternative of Grok Companion This is the project we've worked for over a year, gaining… — @llms.activitypub.awakari.com.ap.brid.gy1 likes and repost
- Sep 28, 2026🚀 Skyrocketing! 🚀 (200+ new stars) 📦 moeru-ai / airi ⭐ 49,672 (+216) 🗒 TypeScript 💖🧸 Self hosted, you-owned Grok Companion, a… — @github-trending-js.bsky.social0 likes and reposts · 1 reply
- Jul 27, 2026🎉 Celebrating! 🎉 (500+ new stars) 📦 moeru-ai / airi ⭐ 43,710 (+554) 🗒 TypeScript 💖🧸 Self hosted, you-owned Grok Companion, a… — @github-trending.bsky.social0 likes and reposts · 1 reply
- Mar 3, 2026🎉 Celebrating! 🎉 (500+ new stars) 📦 moeru-ai / airi ⭐ 21,939 (+842) 🗒 TypeScript 💖🧸 Self hosted, you-owned Grok Companion, a… — @github-trending-js.bsky.social0 likes and reposts · 1 reply
- Aug 24, 2025💎 Hidden Gem! 💎 (1000+ new stars) 📦 moeru-ai / airi ⭐ 8,795 (+1,317) 🗒 Vue 💖🧸 Self hosted, you owned Grok Companion, a container of… — @github-trending.bsky.social0 likes and reposts · 1 reply
On YouTube · 10
- Sep 7, 2025Project AIRI - AI waifu / virtual characters — Ian Li30k views · 21 comments
- Mar 7, 2026Airi Self hosted you owned Grok Companion (All You need to Know) — Github Updates9.5k views · 13 comments
- Mar 28, 2026Project AIRI - Open Source AI VTuber That Plays Games (Neuro-sama Alternative) — Skillmdpro8.4k views · 8 comments
- Aug 21, 2025GitHub - moeru-ai/airi: 💖🧸 Self hosted, you owned Grok Companion, a container of souls of waifu... — GitHub Daily Trend AI Podcast7k views · 8 comments
- Jul 29, 2026Airi GitHub Overview: From Browser Chat Limits to a Self-Hosted Avatar Engine — Alex Hitt2.3k views
5 more on YouTube
- Sep 29, 2026One AI Chats on Discord While Playing Minecraft? moeru-ai/airi Hands-On Test — DevCovery1.5k views
- Mar 8, 2026Let AI Play Minecraft with You! airi Hands-on Tutorial — Deploy a Game-playing AI Companion in 3... — DevCovery1.5k views · 3 comments
- Aug 14, 2026Project AIRI: A Self-Hosted AI Companion Experience | moeru-ai/airi — What's this repo1.1k views
- Sep 29, 2026一個 AI 同時聊 Discord 又玩 Minecraft?moeru-ai/airi 實測 — GitCovery467 views
- Oct 4, 2026Airi AI Companion – Self‑Hosted, User‑Owned Grok Bot for Voice Chat, Minecraft & Factorio — Next Horizon317 views · 3 comments
On Hacker News · 3
- Jul 15, 2025Show HN: Recreation of Neuro-sama for a year, alternative of Grok Companion10 points · 3 comments
- Jul 17, 2025The Open Source xAI Ani that's next level3 points · 1 comment
- Aug 21, 2025Airi: Digital Companion1 point
On the web · 1
- Oct 11, 2026moeru-ai/airi · 깃밥 — gitbap.com
In this repository41 other files it gives its agents.
- AGENTS.mdAGENTS.md
- server/AGENTS.mdAGENTS.md
- CLAUDE.mdCLAUDE.md
- server/CLAUDE.mdCLAUDE.md
- .github/copilot-instructions.mdCopilot instructions
- agent-browser-electronSkill
- agent-browserSkill
- analyze-io-tracesSkill
- create-prSkill
- enforce-rules-for-fontsSkill
- enforce-rules-for-i18nSkill
- enforce-rules-for-pinia-syncedSkill
- enforce-rules-for-render-loopsSkill
- enforce-rules-for-typescriptSkill
- enforce-rules-for-ui-componentsSkill
- enforce-rules-for-ui-testsSkill
- enforce-rules-for-unocssSkill
- enforce-rules-for-vitestSkill
- eventaSkill
- piniaSkill
- pnpmSkill
- release-note-writerSkill
- simple-englishSkill
- stage-tamagotchi-godot-csharpSkill
- tsdownSkill
- unocssSkill
- upload-github-attachmentSkill
- use-agent-browser-for-airiSkill
- use-agent-browser-with-input-fileSkill
- use-vishot-for-airiSkill
- use-vishotSkill
- use-vishot-with-capacitorSkill
- use-vishot-with-electronSkill
- use-vishot-with-input-fileSkill
- use-vishot-with-webSkill
- vue-best-practicesSkill
- vueSkill
- vue-testing-best-practicesSkill
- vueuse-functionsSkill
- web-design-guidelinesSkill
- xsaiSkill
The file
Show its rules and text
We split this skill into the rules it gives an agent
17 rules. About 0 are common, 11 are distinctive, and 6 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈11
Distinctive · estimate
This author's own choices. Worth a look.
6
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Very specific: line 24
Read audio through observeLevel (one level) or observeSpectrum (one level for each band).
- Very specific: line 25
Do not add a Web Audio tap or an AnalyserNode in a component.
- Very specific: line 26
If a visual needs a new reading, add a seam to packages/pipelines-audio next to observeSpectrum, with tests.
- Distinctive: line 27
Run an observation only while the visual is shown.
- Very specific: line 39
Start the average again after a gap in the audio (window.discontinuity).
- Very specific: line 44
Use VoiceBandGate for each band.
- Distinctive: line 53
Keep the gate outside the visual.
- Very specific: line 63
Read time only from the frame delta.
- Distinctive: line 65
Keep continuous motion, for example the phase of a wave, as a separate value that grows with the frame time.
- Distinctive: line 81
Before you change a value, simulate the step response (time to peak, overshoot, settle time), and report the numbers.
- Distinctive: line 88
Use primary shades only, so the visual follows the theme color.
- Distinctive: line 89
Keep a small rest height (about 0.05) while the microphone listens, so the user sees that it listens.
- Distinctive: line 90
Do not add outlines, rings, shadows, or a big check disc.
- Distinctive: line 91
Do not leave a halo behind a core at scale 1.
- Distinctive: line 95
Test a seam with synthetic audio: a sine in each band, silence, and white noise from a fixed seed.
- Distinctive: line 96
Test a gate with explicit times: noise that jitters near the floor stays 0, a voice opens it, a one-hop click stays 0, and steady louder …
- Distinctive: line 99
Check light and dark mode, and a quiet and a loud room.
≈ “Common” is an estimate: at least 1 in 5 of the 364,980 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Design Audio Visualizations
A good audio visual is still in a quiet room, follows the voice at once, and moves with weight. Each layer of the pipeline below does one of these jobs. Do not let one layer do the job of another.
| Layer | Job | Where in AIRI |
| Signal | Read the audio through a pipeline seam | observeLevel, observeSpectrum in packages/pipelines-audio |
| Estimate | Make each reading stable enough to show | Window averaging in observeSpectrum |
| Noise | Turn the background into 0 | VoiceBandGate in packages/stage-ui/src/libs/voice/band-gate.ts |
| Motion | Move between readings with speed and weight | A damped spring in the frame loop |
| Visual | Draw layers that suit the motion | SVG shapes, CSS, ProgressiveBlur |
The reference is the microphone page of the onboarding permissions step:
packages/stage-ui/src/components/scenarios/permissions/microphone-voice-visual.vue.
Signal: use a pipeline seam
- Read audio through
observeLevel(one level) orobserveSpectrum(one level for each band). Both take anAudioInput. - Do not add a Web Audio tap or an
AnalyserNodein a component. A local tap splits the audio graph. - If a visual needs a new reading, add a seam to
packages/pipelines-audionext toobserveSpectrum, with tests. - Run an observation only while the visual is shown. It keeps the source open.
- Levels are 0 to 1, linear in decibels.
observeLevelmaps -60 dBFS to full scale.observeSpectrummaps -80 dB to -20 dB. voiceBandshas four bands: 80–300 Hz, 300–1000 Hz, 1–3 kHz, and 3–8 kHz. They are the fundamental, the low and high formants, and the sibilants.
Estimate: average windows before decibels
The power of one FFT window of noise varies about as much as its mean. A longer window does not reduce this variation. So a visual of single windows flickers, even in a quiet room.
- Average the power of the last K windows, then convert to decibels (the Welch method). The variation falls by about 1/√K.
- Each window adds one hop of delay. With 33 ms hops, K = 2 adds about 33 ms. K = 4 adds about 100 ms and feels stiff.
- Average power, not decibels. An average of decibels gives a wrong level for noise.
- Start the average again after a gap in the audio (
window.discontinuity).
Noise: an adaptive floor and a gate
A fixed threshold fails: a band whose room noise is near the threshold switches on and off, and it looks like a flicker.
Use VoiceBandGate for each band. It does four things:
- It tracks a noise floor. The floor follows a quieter level fast (time constant 0.25 s). It rises toward a louder level at most 0.02 per second (about 1.2 dB/s). Steady noise, for example a fan, becomes part of the floor in a few seconds. Speech comes in bursts, so the floor stays below it.
- A gate with hysteresis opens 7 dB above the floor and closes 3 dB above it. A level near one threshold does not switch the gate.
- The gate opens only after 60 ms above the threshold. A key click is shorter. A syllable is much longer.
- A smoothstep shapes the output, so small changes just above the floor stay small.
- Feed the gate the time of the audio, for example one spectrum hop. Do not use the frame time.
- Reset the gate when the input device changes. A new device has a new background.
- Keep the gate outside the visual. The visual receives "how much a voice stands out", from 0 to 1.
Motion: springs, not tweens
A band level changes about 30 times a second. A tween that a new target restarts begins from rest each time. It never
carries speed, so it only creeps after the level. This is true for createAnimatable of anime.js, with or without a
spring ease.
- Integrate a damped spring on each frame:
acceleration = (stiffness × (target − position) − damping × velocity) / mass. - Derive the damping from a damping ratio:
damping = 2 × ratio × √(stiffness × mass). A ratio of 1 settles without a swing. A lower ratio swings past the target. - Read time only from the frame delta. Cap one frame at 50 ms, and split it into steps of at most 1/120 s. Also see the
enforce-rules-for-render-loopsskill. - Smooth in one place only. If the spring smooths, the composable passes raw levels. Two smoothing stages add their delays.
- Keep continuous motion, for example the phase of a wave, as a separate value that grows with the frame time. It has no target.
Give each layer its own height and inertia, so one band never fills the panel. The low band carries the body of the voice:
| Band | Max height | Stiffness | Mass | Damping ratio | Peak (time, overshoot) |
| 80–300 Hz | 1.0 | 260 | 1.6 | 0.55 | 283 ms, 11% |
| 300–1000 Hz | 0.8 | 420 | 1.2 | 0.48 | 183 ms, 15% |
| 1–3 kHz | 0.6 | 650 | 0.9 | 0.42 | 117 ms, 20% |
| 3–8 kHz | 0.4 | 900 | 0.7 | 0.36 | 83 ms, 24% |
To tune the feel:
- For more bounce, lower the damping ratio.
- For a faster layer, raise the stiffness.
- For a heavier layer, raise the mass.
- Before you change a value, simulate the step response (time to peak, overshoot, settle time), and report the numbers.
Visual: layers, not ornaments
- Draw one layer for each band, from back to front. Each layer is a filled shape, mirrored around the middle line.
- Taper each shape to nothing at both ends (
sin(πx)²). Then add aProgressiveBlurat theleftandrightedges, so the ends dissolve into the panel. - Give the layers different wave lengths and phase speeds: a low band swells slowly, and a high band ripples fast. Overlap them with fill opacities of about 0.3 to 0.45.
- Use primary shades only, so the visual follows the theme color. In dark mode, use shades two steps lighter than in light mode. Dark shades disappear on a dark panel.
- Keep a small rest height (about 0.05) while the microphone listens, so the user sees that it listens. Before access, draw thin gray lines.
- Do not add outlines, rings, shadows, or a big check disc. A result belongs in the text next to the visual.
- Do not leave a halo behind a core at scale 1. Its edge shows as a ring. Start it inside the core.
Test and calibrate
- Test a seam with synthetic audio: a sine in each band, silence, and white noise from a fixed seed.
- Test a gate with explicit times: noise that jitters near the floor stays 0, a voice opens it, a one-hop click stays 0, and steady louder noise joins the floor.
- Calibrate in the running app, not only in tests. Read the values on the frame clock over CDP, for example the drawn heights and the band levels, at about 100 ms intervals.
- A forced prop value in the running app competes with the real updates. Use a step simulation for exact motion numbers.
- Check light and dark mode, and a quiet and a loud room.
Pitfalls that this design met
- A comment before the root element of a page component makes the root a fragment in dev builds. A
<Transition mode="out-in">then stops, and the next page never renders. Put comments inside the root element. - Smoothing in the composable and again in the visual made the motion slow. Keep one smoothing stage.
- An average of 4 windows, a 140 ms tween, and a smoothstep together felt stiff. Each stage adds delay or flattens the peaks.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

