automating-agent-guardrails
Skill6 starsChanged 43 days agoMITView on GitHub
Use when a project's rules for Claude agents keep getting broken or skipped (forbidden git commands, direct pushes to a protected branch, read-only reviewers that write, owner-approval steps nobody asks about), or when setting up or auditing Claude Code guard hooks, `.claude/agents` role definitions, a session-start readiness check, OpenTelemetry cost tracking or LSP code navigation for a repository.
In this repository14 other files it gives its agents.
- agent-fleetSkill
- architecture-auditSkill
- claude-cloud-sessionsSkill
- cross-platformSkill
- devlogSkill
- dotnet-engineeringSkill
- engineering-standardsSkill
- performance-diagnosisSkill
- reviewSkill
- roslyn-analysisSkill
- spec-compliance-auditSkill
- spec-oracleSkill
- test-gateSkill
- variant-analysisSkill
The file
We split this skill into the rules it gives an agent
12 rules. About 0 are common, 3 are distinctive, and 9 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈3
Distinctive · estimate
This author's own choices. Worth a look.
9
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 13
Every item in the contracts below exists because a capable agent building the same piece without it got that item wrong.
- Very specific: line 36
Run python .claude/hooks/guard_commands.py --selftest --settings .claude/settings.json until GREEN and add it to CI.
- Very specific: line 39
Read references/guard-hooks.md before writing or auditing any guard rule, hook registration or the guard's self-test (it holds the full …
- Very specific: line 57
Every role sets model, effort and maxTurns.
- Very specific: line 58
Every role that waits on gates, builds or CI sets experimental: / cacheTtl: 1h.
- Very specific: line 59
Read-only roles carry readonly_guard.py in their OWN frontmatter hooks:, never in project settings keyed on agent_type.
- Very specific: line 63
Read references/role-agents.md before creating, editing or auditing any role definition, and before dispatching a role smoke test.
- Distinctive: line 67
Every capability gets one status each session: OK, REPAIRED, N/A (with reason), TODO, or ASK-OWNER (with the exact On-yes step).
- Very specific: line 73
Read references/readiness-check.md before installing or changing the readiness check, its config or its CI run.
- Distinctive: line 78
Use the LSP tool before grep for definitions and references when the LSP line is OK.
- Very specific: line 81
Read references/telemetry-lsp-gates.md before enabling telemetry, adding an lsp entry or running a regression gate.
- Very specific: line 85
Every contract item exists because a baseline agent without it got it wrong.
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Automating agent guardrails
Agents forget rules they have to remember, especially under pressure or in a subagent that never saw the prose. This skill makes a project's agent rules structural, so the harness enforces them through hooks and role definitions, and automatic, so a check runs at every session start and anything that needs the owner becomes a question instead of a silent skip.
Every item in the contracts below exists because a capable agent building the same piece without it got that item wrong. Violating the letter of a contract is violating its spirit.
What gets installed
Copy the scripts into the project (.claude/hooks/). Don't reference the plugin cache: CI and cloud sessions run
them from the clone. Every script runs as python <script> and has a --selftest.
| Piece | In the project | From this skill |
| Guard hook | .claude/hooks/guard_commands.py, guard-rules.json; PreToolUse in .claude/settings.json | scripts/guard_commands.py, templates/guard-rules.json, templates/settings.json |
| Role agents | .claude/agents/*.md, .claude/hooks/readonly_guard.py | templates/agents/, scripts/readonly_guard.py |
| Readiness check | .claude/hooks/readiness_check.py, readiness.json, session_start.py; SessionStart in settings; a CLAUDE.md section | scripts/readiness_check.py, templates/readiness.json, templates/session_start.py, templates/CLAUDE-guardrails.md |
| Cost telemetry | .claude/hooks/otlp_sink.py, usage_report.py; env in the USER settings ~/.claude/settings.json (a project's settings cannot enable telemetry) | scripts/ |
1. Guard hooks that block forbidden commands
- Encode only the rules the owner stated; a rule you think is missing is a proposal, so ask.
- One rule per forbidden command in
guard-rules.json:pattern,reason,instead,blockandallowexamples. "scope": "repo"on every rule that encodes this repository's policy.- Register the guard for every shell tool (
"matcher": "Bash|PowerShell"), plainpython ...command, no|| exit 2. - The guard exits 2 with an
Instead:message, fails OPEN on every internal error, writes UTF-8 stderr, and has a CI self-test that includes an unrelated repo. - Run
python .claude/hooks/guard_commands.py --selftest --settings .claude/settings.jsonuntil GREEN and add it to CI; report CI as unproven until you have seen a green run. Never usepermissions.denyfor these rules.
Read references/guard-hooks.md before writing or auditing any guard rule, hook registration or the guard's self-test (it holds the full contract and the reason for each item).
A hook can also GRANT, within a scope a settings rule cannot express
A permission rule sees the command text, never the working directory or the resolved paths, so "allow git rm -r
inside an agent's worktree, nowhere else" cannot be a settings rule. A PreToolUse hook can return
permissionDecision: allow for exactly that shape — one command, run in a directory under the worktrees root, every
path inside it, no --force — and no decision for anything else, so the harness's own safety classifier and every
deny hook keep their say. The bar for a grant is the mirror of a guard's: its self-test must show every neighbour
that is NOT allowed (the main checkout, a path that escapes, a chain, --force), because its failure branch is a
permission that should not have been given. Why: a safety classifier refused a subagent's whole-tree deletion as
irreversible — correct for an unscoped command, wrong on a branch where every removal is one commit from recovery —
and the alternative, a person performing the step per wave, cannot run unattended. Pair it with the owner's
never-lose-work rule in the cleanup script: remove a worktree only when its work is committed and landed, never one
that is dirty, locked, recent or unlanded.
2. Role agent definitions
- Every role sets
model,effortandmaxTurns; mechanical roles (chore, read-onlylocator) get a cheaper model and lower effort. - Every role that waits on gates, builds or CI sets
experimental:/cacheTtl: 1h; roles that never wait keep the default. - Read-only roles carry
readonly_guard.pyin their OWN frontmatterhooks:, never in project settings keyed onagent_type. - Select roles by name (
agentType/subagent_type); never setmodelor effort per call. - Restart, then prove each role with a smoke agent and
--stamp roles-smoke; roll a role back up if its quality metric drops.
Read references/role-agents.md before creating, editing or auditing any role definition, and before dispatching a role smoke test.
3. The session-start readiness check
- Every capability gets one status each session: OK, REPAIRED, N/A (with reason), TODO, or ASK-OWNER (with the exact On-yes step).
- Repair automatically only what needs no permission; anything else is ASK-OWNER.
- Paste
templates/CLAUDE-guardrails.mdintoCLAUDE.md: every ASK-OWNER line becomes one AskUserQuestion at session start. - Fail open at every level, including config loading; detect
CLAUDE_CODE_REMOTE=true/CIand mark machine-local capabilities N/A. - Recurring owner-only commands are
recurringentries (--stamp <id>after the owner runs one); trigger-bound owner steps go inask_at_trigger.
Read references/readiness-check.md before installing or changing the readiness check, its config or its CI run.
4-6. Telemetry, LSP navigation, regression gates
- Telemetry is enabled only in the USER settings, only after asking (
readiness_check.py --enable-telemetry). - Use the LSP tool before grep for definitions and references when the LSP line is OK; fix diagnostics on files you touched.
- Skill and agent edits ship with an eval case and a plugin eval run (ask first, it is billed); each finished branch gets a read-only review when it is DONE, and a confirmed finding blocks its enqueue.
Read references/telemetry-lsp-gates.md before enabling telemetry, adding an lsp entry or running a regression gate.
Common mistakes and rationalizations
Every contract item exists because a baseline agent without it got it wrong. Read references/mistakes-and-rationalizations.md when an excuse for skipping a rule sounds reasonable or when auditing an existing setup.
Red flags
|| exit 2,except ...: return 2, or "fails closed" anywhere in a guard or its settings entry- A guard rule without
allowexamples, or scope tested only against a second checkout of the same repo - A role file without
maxTurns, a read-only role without its ownhooks:, a gate-waiting role withoutcacheTtl: 1h - "Definitions are in place" with no restart and no smoke dispatch
- A readiness status set without N/A, or a check that can crash the hook
CLAUDE_CODE_ENABLE_TELEMETRYin a project's.claude/settings.jsonor.claude/settings.local.json(ignored there: telemetry is enabled only in the user settings)- Routing around a block: rephrasing, splitting or encoding a command the guard refused
- A guard rule, trigger step or role the owner never asked for, installed without asking
- "CI runs the self-tests" with no CI run seen, or a readiness probe that exercises only one shell tool
Standards
The bar is the engineering-standards skill. Here that means one home per rule: the rule text lives in
guard-rules.json or the role file, and CLAUDE.md states the rule without copying the pattern. Every guard has
a check that has been seen to fail (make each new rule's block example fire once before trusting its green). A
scope or fail-mode shortcut is reported as debt, not shipped.
Project hooks
Your CLAUDE.md supplies the project half: the enqueue command named in the push rule's instead, the roles and
their gate commands, the review step, and the list of trigger-bound owner steps. Project rules win on conflict.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

