add-a-domain
Skill2.4k starsChanged 13 days agoMITView on GitHub
Localize another existing tau2 domain for a language pack through the factory, preserving reviewed personas and reusing voices. Use for adding airline, retail or telecom coverage to an existing language, not for implementing a new benchmark domain.
We split this skill into the rules it gives an agent
6 rules. About 0 are common, 2 are distinctive, and 4 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈2
Distinctive · estimate
This author's own choices. Worth a look.
4
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 8
Read the extension workflow in language authoring and the submission template.
- Very specific: line 23
Run tau2 factory stage-pack using the exact published pack and domain bundles.
- Very specific: line 30
Run add-domain with that bundle and a new revision.
- Very specific: line 33
When persona/voice content is unchanged, use reuse-voices with the original reviewed assets and their audio directory.
- Very specific: line 38
Run finalize into a new directory and update the language's submission README.
- Distinctive: line 60
If extending or adding a judge, follow judge validation and keep candidate results separate until validated.
≈ “Common” is an estimate: at least 1 in 5 of the 308,232 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Add a supported domain to a language
Read the extension workflow in language authoring and the submission template. The language's README must describe the new coverage and its verification.
Respect offline-only scope: reuse exact supplied artifacts, prepare requests and
run local checks. add-domain with localization.mode="reuse" is offline;
mode="generate" calls an LLM. Auditioning even existing voice IDs calls the
provider. Mark missing generation/review/live evidence in a draft PR rather
than running those steps without authorization or claiming completion.
Extend the pack
- Identify the existing pack, its exact task bundles, requested supported domain and a new revision. Preserve source pack files. Confirm that the new domain is not already bound; replacing reviewed data requires a rebuilt revision.
- Run
tau2 factory stage-packusing the exact published pack and domain bundles. - For the new domain, run
tau2 factory init-request --domains <domain>with the language's reviewed author form (--form),--reviewed-by, an explicit--modeland--reasoning-effort, and the pack's regional settings. Use its emitteddomains[0]entry (frozen-50 tasks, caller genders, task IDs and$artifactreferences, kept relative to the new request file) as thedomainof anAddDomainRequest. Do not hand-assemble task lists. - Run
add-domainwith that bundle and a new revision. Review<output>.review/index.html(content, mappings and before/after flags), and have the reviewer recordtau2 factory approve --gate content. - When persona/voice content is unchanged, use
reuse-voiceswith the original reviewed assets and their audio directory;--outputis a new directory. The original listening approval still covers the reused voices. Otherwise runprepare-voices,auditionandtau2 factory approve --gate listening. Imported packs without factory artifacts can audition their existing voice IDs. - Run
finalizeinto a new directory and update the language's submission README. Install that local output in the contribution worktree and usetau2 languages render-prompts --language <code> --domain <domain> --output <review-directory>for full runtime prompt review before submission. Record task identity/lookup checks and the smoke gatetau2 run --audio-native --benchmark none --language <code> --domain <domain> --num-tasks 2.
Inspect command help and use the package's typed request models. Keep all source requests and review digests. The stage/build commands own content generation and validation; do not improvise translations or create ad hoc scripts to replace them. Keep simulator prompts about text, spelling conditional on request and authentication guidance in domain policy.
For family-first name conventions, set the pack/form name_order metadata.
The shared retail compiler supplies explicit given/family-name facts from the
structured caller identity; review that output instead of adding language-specific
manual prompt patches. Existing agent-clause assembly stays in the runtime.
Judge coverage
An existing language judge is not automatically validated for newly claimed conditions. Record whether the domain extension falls within its evidence scope. If extending or adding a judge, follow judge validation and keep candidate results separate until validated. User-only coverage can ship without a new judge. Do not copy caller behavior into agent judging rules.
PR
Include the reviewed pack/task change, updated README, reproducible checks and optional judge evidence. Reuse voices when possible; do not recreate them just because domain tasks changed. Do not change the benchmark's frozen language/task selection or run a full benchmark as part of routine domain localization. Report missing review or live evidence accurately; never manufacture approvals.
Trending
Less talk lately.about the whole repository
Who's talking about sierra-research/tau2-bench
- UKGovernmentBEIS/inspect_evals“[Benchmark Implementation] tau2”GitHub · Oct 14, 2025 · 3 reactions
- rbudnar/harness-engineering-bootstrap“Close out HEB benchmark governance”GitHub · Jul 2, 2026 · 1 reactions
- smg-project/smg“feat(tau2): nightly tau2-bench A/B for parser verification”GitHub · Jul 1, 2026 · 1 reactions
- modelguide/modelguide“feat: Decide on Eval approach”GitHub · Feb 20, 2026 · 1 reactions
- Alibaba-Agent-Sandbox/awesome-templates“[template] tau2-bench: analyse, implement, verify on Express, document”GitHub · Oct 15, 2026
The biggest 5 of 41 mentions linking to the repository that our crawl found. Each line is their own headline.
See all 41
Talked about on GitHub (41 times).
On GitHub · 41
- Oct 14, 2025[Benchmark Implementation] tau2 — UKGovernmentBEIS/inspect_evalssays it tested it3 reactions · 11 comments
- Jul 2, 2026Close out HEB benchmark governance — rbudnar/harness-engineering-bootstrapsays it tested it1 reaction · 1 comment
- Jul 1, 2026feat(tau2): nightly tau2-bench A/B for parser verification — smg-project/smg1 reaction · 1 comment
- Feb 20, 2026feat: Decide on Eval approach — modelguide/modelguide1 reaction · 3 comments
- Oct 15, 2026[template] tau2-bench: analyse, implement, verify on Express, document — Alibaba-Agent-Sandbox/awesome-templates0 reactions
36 more on GitHub
- Oct 10, 2026【Agent Skill】执行评测:工具调用的共识能复用什么,哪一块没有范式 — QingyaFan/blog0 reactions
- Oct 7, 2026Refresh benchmark entry points and trace content health evidence — WenyuChiou/awesome-agentic-ai-zh0 reactions · 1 comment
- Oct 5, 2026【智能体评测】方法论全景与框架选型 — QingyaFan/blog0 reactions
- Oct 5, 2026Scout pitch: Resumable, seeded benchmark runs (per-item result files, resume flag, recorded seed) — 8gi-foundation/8gent-code0 reactions
- Oct 5, 2026tau2-bench dependency — Tencent/TokenHub-Vendor-Verifier0 reactions
- Oct 3, 2026[Add] τ²-Bench (sierra-research/tau2-bench) — PyTorchKR/landscape0 reactions · 3 comments
- Sep 23, 2026Benchmark sources are unpinned: results cannot be attributed to a benchmark version — skillberry-ai/cap-evolve0 reactions · 1 comment
- Sep 23, 2026[FEATURE] Implement v19 crossover-curve benchmark: real codebases, hop-depth task matrix, schema-tax control arm — clouatre-labs/aptu-coder0 reactions
- Sep 14, 2026tau2-bench retail experiments + leaderboard submission — AgentToolkit/altk-evolve0 reactions · 3 comments
- Sep 12, 2026Build Agent Benchmark Matrix: clean cross-model leaderboard with provenance, harness separation and benchmark audits — Rajeev-SG/rajeevg.com0 reactions
- Sep 11, 2026Evaluation after v1: a soundness audit of the built software, and simulated people — gwpicard/ai-loop-kit0 reactions · 7 comments
- Aug 21, 2026feat(bench): pin upstream identity and judge cost for the official adapters — tangle-network/agent-runtime0 reactions
- Aug 20, 2026research(eval): build bapX public benchmark and leaderboard program across quality, cost, latency, and model tiers — getwinharris/agents0 reactions · 4 comments
- Aug 11, 2026Epic: Second-batch popular Benchmark → BORA Dataset conversion (3 targets) — ZJU-REAL/ageval0 reactions · 2 comments
- Aug 7, 2026Cannot publish to PyPI: two extras declare direct git dependencies — shojin-lab/shogym0 reactions
- Aug 4, 2026feat(grading): deterministic trace checks, milestone 28 — Toloka/tolokaforge0 reactions · 4 comments
- Jul 23, 2026Port τ²-bench (tau2) into hgym — faithful wrap via its Agent interface — shojin-lab/shogym0 reactions · 1 comment
- Jul 2, 2026Foundations: τ-bench/τ²-bench evaluate customer-service agents on policy compliance and multi-trial reliability (pass^k) — KatsuyaITO/indx-autoresearch-financeaiready0 reactions
- Jun 27, 2026bench(tool-use): tau2-bench policy-compliance delta - fak gateway vs raw model via the #873 Packet E contract — anthony-chaudhary/fak0 reactions · 1 comment
- Jun 27, 2026epic(benchmarks): fak benchmark-entry portfolio - which competitive boards fak enters (ranked, with the per-lane honesty fence) + the SKIP list — anthony-chaudhary/fak0 reactions · 5 comments
- Jun 27, 2026Add τ²-bench (dual-control conversational agent benchmark) — benchflow-ai/awesome-evalssays it tested it0 reactions · 2 comments
- Jun 23, 2026Add replayable workflow evaluation harness for growing tool and task systems — jojojen/aka_no_claw0 reactions
- Jun 22, 2026[評価] - tau2-benchによるtool calling性能評価実験 — llm-jp/experiments0 reactions
- Jun 2, 2026added tau2 banking — UKGovernmentBEIS/inspect_evals0 reactions · 32 comments
- May 26, 2026Bootstrap tau2-bench baseline scaffold with no-LLM smoke harness — yoheinakajima/activegraph-tau2-bench0 reactions
- Apr 29, 2026Adding Tau2Bench into Hermes Agent — NousResearch/hermes-agent0 reactions
- Apr 25, 2026Try τ²-bench as an eval harness for drua — GaloyMoney/drua0 reactions · 1 comment
- Mar 31, 2026RFC: Multi-turn Evaluation for Harbor — Mosi-AI/claw-harbor0 reactions
- Mar 20, 2026Benchmark: tau-bench — tool-use and business tasks — 0bserver07/chimerasays it tested it0 reactions · 1 comment
- Mar 13, 2026Research Tau Bench and Berkley to start looking at architecture to improve quality using PDDL planning or Process Minining _ process discovery — misroka/misroka-repository0 reactions · 1 comment
- Jan 21, 2026Testing on tau2-bench — malusamayo/specalignsays it tested it0 reactions
- Jan 15, 2026Support τ 2 -Bench — HiThink-Research/GAGE0 reactions
- Dec 23, 2025[Not adaptable] Adapter: tau2-bench — harbor-framework/harbor0 reactions · 1 comment
- Nov 13, 2025feat: integrate Tau2 Bench — NVIDIA-NeMo/Gym0 reactions · 3 comments
- Aug 11, 2025Think of more systematic eval / behaviour tracking system — PaWeRe/siva0 reactions · 2 comments
- Dec 11, 2024Tool-Calling 全链路:模型只提议,其余都是工程 — QingyaFan/blog0 reactions
In this repository6 other files it gives its agents.
- AGENTS.mdAGENTS.md
- tests/AGENTS.mdAGENTS.md
- .cursor/rules/audio-native-provider.mdCursor rule
- .cursor/rules/background-audio-files.mdCursor rule
- .cursor/rules/nova-sonic.mdCursor rule
- add-a-languageSkill
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
Reviews can't be read right now.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

