spec-fidelity-review
Skill0 starsChanged 4 months agoMITView on GitHub
Review a diff against what was asked — ticket, acceptance criteria, PDR/ADR, product requirements, PR description — instead of against the code. Use when asked whether a change matches its spec/ticket/requirements, or as the spec-fidelity lens of a multi-lens review. Skip when no spec source exists (report that instead of inventing one) and for code-quality review (staff-review) or invariant sweeps (invariant-audit).
In this repository16 other files it gives its agents.
- answer-shapesSkill
- claim-verificationSkill
- create-prSkill
- findings-ledgerSkill
- git-safetySkill
- invariant-auditSkill
- lossless-doc-compressSkill
- model-orchestrationSkill
- office-hoursSkill
- plan-reviewSkill
- prompt-caching-playbookSkill
- review-ratchetSkill
- staff-reviewSkill
- systematic-debuggingSkill
- test-adequacy-reviewSkill
- verification-before-completionSkill
The file
We split this skill into the rules it gives an agent
2 rules. About 0 are common, 2 are distinctive, and 0 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈2
Distinctive · estimate
This author's own choices. Worth a look.
0
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 45
Run in a fresh context with only the spec sources and the diff — not the author's reasoning, not other lenses' output.
- Distinctive: line 47
Never rerank against other lenses' findings.
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Spec fidelity review
This lens never reads the code for quality — it reads it for conformance. Code that follows every standard but implements the wrong thing passes every other lens and fails this one.
Sources
Assemble the requirement set first, citing where each item comes from: ticket acceptance criteria, PDR/ADR decisions, product requirement docs, and claims in the PR description. If none exist, stop and report "no spec available" — this lens without a spec is a hallucination generator.
Method
- Forward pass — requirement → evidence. For each requirement: implemented? where (file:line)? Quote the implementing code. Missing or partial = finding.
- Reverse pass — behavior → authorization. For each behavior change in the diff: which requirement asks for it? Unauthorized behavior = scope creep finding.
- Quantifier pass. The classic silent violation is a changed cardinality, scope, or actor, not a missing feature: "once per attempt" becoming "once per transaction", "only on no-match" becoming "on every check", per-user becoming per-account. Compare the spec's quantifiers (per what? when? who?) against what the code actually keys on.
- Staleness pass. Spec statements the diff invalidates (a PDR describing an architecture this change replaces, a doc describing a removed call site) are findings too — the spec is part of the deliverable.
- Quote the spec line for every finding. A conformance finding without the requirement text it violates is an opinion.
Rules
- Run in a fresh context with only the spec sources and the diff — not the author's reasoning, not other lenses' output.
- Never rerank against other lenses' findings; conformance and quality are deliberately separate verdicts.
- Findings go to the findings-ledger like any other review output.
Provenance
Lens separation motivated by perspective-based reading (Basili et al., NASA SEL: distinct perspectives find near-disjoint defect sets) and validated locally: in an internal retrospective (2026-08) the code/platform reviewer and the requirements reviewer overlapped on almost nothing, and the two costliest late findings — a billed check whose contract said once per attempt silently becoming once per transaction, and an alert firing on every check where the requirement said only on mismatches — are exactly passes 3 and 1. Mechanics adapted from the two-axis review in mattpocock/skills (parallel sub-agents, never merge across axes, quote the spec line).
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

