failure-scan
Skill0 starsChanged 5 months agoMITView on GitHub
Review the current code changes (the git diff, or named files) against the failure-mode catalog — especially the judgment classes a hook can't catch (plausible-but-wrong AI/LLM output, biased per-segment statistics, implicit coordination via dispatch order). Use when finishing a change, before committing, or when the failure-mode hook nudges you. Reports concrete risks with the catalog's verify questions and fix patterns.
In this repository10 other files it gives its agents.
- claude-md-auditSkill
- coverage-auditSkill
- design-noteSkill
- handoffSkill
- memory-auditSkill
- noteSkill
- orchestrateSkill
- public-readySkill
- scaffold-mcpSkill
- verify-mcpSkill
The file
We split this skill into the rules it gives an agent
3 rules. About 0 are common, 3 are distinctive, and 0 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈3
Distinctive · estimate
This author's own choices. Worth a look.
0
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 22
Read the whole catalog so you have every class, its smell, its Verify questions, and its Fix pattern.
- Distinctive: line 30
If both are empty, diff against the default branch (git diff main...HEAD) or the last commit (git show).
- Distinctive: line 56
If a class doesn't apply, dismiss it in a few words ("n/a — no LLM surface").
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
/failure-scan
Review the current changes against the failure-mode catalog and report any bug class this change plausibly exhibits. The PostToolUse hook already auto-flags the grep-able classes (e.g. silent-data-growth). Your job is the judgment classes a regex can't catch — while still sanity-checking the grep-able ones in context.
1. Load the catalog (the single source of bug classes)
Find and read catalog.md. Try, in order:
~/.claude/failure-modes/catalog.md(standalone install)- the installed-plugin copy:
find ~/.claude/plugins -path '*failure-modes/catalog.md' 2>/dev/null - a repo-vendored copy:
failure-modes/catalog.mdunder the project root.
Read the whole catalog so you have every class, its smell, its Verify questions, and its Fix pattern. If you genuinely can't find it, say so and fall back to the judgment classes named in this skill's description, plus silent-data-growth (the grep-able seed class).
2. Decide what to review
- Default: the uncommitted work —
git diff HEADplusgit diff --staged. If both are empty, diff against the default branch (git diff main...HEAD) or the last commit (git show). - If the user named files/paths in the invocation, review those instead.
- State the scope you reviewed (diff range or file list) up front.
3. Review against every class — judgment classes hardest
For each class in the catalog, decide whether this change plausibly exhibits it, using that class's Verify questions as your rubric. Weigh hardest:
- plausible-but-wrong-ai — any LLM/agent/tool/prompt change: silently dropped constraints, a tool docstring or prompt changed without running evals, output that reads fine but could be subtly wrong.
- segment-stat-bias — a statistic computed per-user / per-segment on small or uneven samples, or an objective quantity modeled per-segment when it could be universal.
- dispatch-order-coupling — multiple sources can fire for one target, coordinated by ad-hoc "skip if already handled" checks rather than an explicit priority resolver.
Rules for the review itself:
- Be concrete: cite
file:lineand quote the relevant code. - Grade each finding: confirmed / worth a look / checked — clear.
- Do not invent issues to seem thorough. A calm "nothing here" is a valid, valuable result — manufacturing findings is itself the plausible-but-wrong failure mode, applied to you.
- If a class doesn't apply, dismiss it in a few words ("n/a — no LLM surface").
4. Report
For each flagged class:
- Class — and where (
file:line). - Why it might be an instance (1–2 lines, grounded in the code).
- Fix pattern — quoted from the catalog entry.
End with a one-line verdict: clear, or N issues worth addressing. Honest and specific beats exhaustive.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

