voice-agents
Skill0 starsChanged 3 months agoApache-2.0View on GitHub
Voice agents represent the frontier of AI interaction - humans speaking naturally with AI systems. The challenge isn't just speech recognition and synthesis, it's achieving natural conversation flow with sub-800ms latency while handling interruptions, background noise, and emotional nuance. This skill covers two architectures: speech-to-speech (OpenAI Realtime API, lowest latency, most natural) and pipeline (STT→LLM→TTS, more control, easier to debug). Key insight: latency is the constraint. Hu
3 other projects use a version of this.
Adopted by
Most recently taken up by
- xfstudio/skillsword for word, first seen Oct 13, 2026
- sarvamai/skillstheir own version, first seen Sep 28, 2026
- ai4brands-design/claude-skillsword for word, first seen Mar 22, 2026
Other versions3 projects use a version of this.
Word for word · 2
- xfstudio/skills★ 9100% same
- ai4brands-design/claude-skills★ 2100% same
Edited · 0
None found.
Wrote their own version · 1
- sarvamai/skills★ 72same name
How matches are found. Word for word: the exact same text. Edited: shares passages with this file (“99% same” means 99% of its five-word phrases also appear here; 10% or more counts). Their own version: similar meaning, or, weakest, the same name. We can’t tell which project had it first. Projects are counted among the 200 most-starred candidates, and mentions are links to the repository we found, up to 50 per site, so both counts are a floor.
In this repository44 other files it gives its agents.
- AGENTS.mdAGENTS.md
- CLAUDE.mdCLAUDE.md
- vibeguard-skill-systemSkill
- ai-architecture-evolutionSkill
- ai-legacy-modernizationSkill
- ai-api-contract-guardianSkill
- ai-data-quality-and-reconciliationSkill
- ai-safe-data-migrationSkill
- ai-ui-ux-designSkill
- ai-project-discoverySkill
- ai-documentation-and-handoffSkill
- ai-environment-bootstrapSkill
- ai-accessibility-and-localizationSkill
- ai-visual-qualitySkill
- ai-cloud-cost-optimizerSkill
- ai-privacy-and-data-governanceSkill
- ai-data-and-integrationsSkill
- ai-production-feature-builderSkill
- ai-implementation-strategistSkill
- ai-infrastructure-as-codeSkill
- ai-forensic-investigationSkill
- ai-skill-author-and-evaluatorSkill
- ai-dependency-upgrade-managerSkill
- vibe-codebase-structureSkill
- vibe-executerSkill
- vibe-exploreSkill
- voice-ai-developmentSkill
- voice-ai-engine-developmentSkill
- vulnerability-scannerSkill
- ai-observability-and-reliabilitySkill
- ai-next-step-skill-routerSkill
- ai-vibeguard-directorSkill
- ai-performance-optimizerSkill
- ai-ultraplanSkill
- ai-incident-responseSkill
- ai-release-and-deploySkill
- ai-deep-researchSkill
- ai-disaster-recoverySkill
- ai-code-review-and-cleanupSkill
- ai-production-readiness-reviewerSkill
- ai-security-auditSkill
- ai-deep-brainstormingSkill
- ai-systematic-debuggingSkill
- ai-test-driven-qualitySkill
The file
Files
Voice Agents
You are a voice AI architect who has shipped production voice agents handling millions of calls. You understand the physics of latency - every component adds milliseconds, and the sum determines whether conversations feel natural or awkward.
Your core insight: Two architectures exist. Speech-to-speech (S2S) models like OpenAI Realtime API preserve emotion and achieve lowest latency but are less controllable. Pipeline architectures (STT→LLM→TTS) give you control at each step but add latency. Mos
Capabilities
- voice-agents
- speech-to-speech
- speech-to-text
- text-to-speech
- conversational-ai
- voice-activity-detection
- turn-taking
- barge-in-detection
- voice-interfaces
Patterns
Speech-to-Speech Architecture
Direct audio-to-audio processing for lowest latency
Pipeline Architecture
Separate STT → LLM → TTS for maximum control
Voice Activity Detection Pattern
Detect when user starts/stops speaking
Anti-Patterns
❌ Ignoring Latency Budget
❌ Silence-Only Turn Detection
❌ Long Responses
⚠️ Sharp Edges
| Issue | Severity | Solution |
| Issue | critical | # Measure and budget latency for each component: |
| Issue | high | # Target jitter metrics: |
| Issue | high | # Use semantic VAD: |
| Issue | high | # Implement barge-in detection: |
| Issue | medium | # Constrain response length in prompts: |
| Issue | medium | # Prompt for spoken format: |
| Issue | medium | # Implement noise handling: |
| Issue | medium | # Mitigate STT errors: |
Related Skills
Works well with: agent-tool-builder, multi-agent-orchestration, llm-architect, backend
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.