auditing-progress
Skill179 starsChanged 7 months agoApache-2.0View on GitHub
Use when an iteration has just finished and you need to verify behavior evidence quality in three tiers — deep evidence for current stories, impacted behavior for touched scenarios, and sentinel corpus for high-value regression detection.
In this repository5 other files it gives its agents.
The file
We split this skill into the rules it gives an agent
4 rules. About 0 are common, 2 are distinctive, and 2 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈2
Distinctive · estimate
This author's own choices. Worth a look.
2
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Very specific: line 22
Read the per-epic requirement files in docs/superpowers/iterations/requirements/, docs/superpowers/iterations/behavior-scenarios.md, and …
- Distinctive: line 25
Tier 2 — Impacted behavior: all existing scenarios whose owning stories had code changes in this iteration (even if those stories were …
- Very specific: line 26
Tier 3 — Sentinel corpus: all scenarios with run cadence sentinel in the behavior corpus.
- Distinctive: line 38
Wait for both to return
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Auditing Progress
Overview
Runs after every iteration as part of the planning cycle. Verifies behavior evidence quality in three tiers using parallel adversarial review (PAR) — two paired auditor subagents evaluate the same work in parallel with competitive framing.
The audit answers: "Does durable, reusable evidence exist at the correct seam for every externally observable behavior this iteration touched?"
When to Use
Invoked by iterative-development after every running-an-iteration call, before picking the next iteration.
Audit Process
1. Partition the audit into three tiers
Read the per-epic requirement files in docs/superpowers/iterations/requirements/, docs/superpowers/iterations/behavior-scenarios.md, and docs/superpowers/iterations/behavior-corpus.md:
- Tier 1 — Deep evidence: stories marked
done:ITER-<current>and scenarios added or updated in this iteration. Audit every AC and its proof obligation thoroughly. - Tier 2 — Impacted behavior: all existing scenarios whose owning stories had code changes in this iteration (even if those stories were completed in earlier iterations). Verify the scenarios still pass.
- Tier 3 — Sentinel corpus: all scenarios with run cadence
sentinelin the behavior corpus. Compare against the pre-iteration baseline fromrunning-an-iterationstep 3.
2. Dispatch paired auditor subagents (PAR)
Following the PAR methodology in skills/shared/parallel-adversarial-review.md:
- Build the auditor prompt using
auditor-subagent-prompt.md. Include ALL THREE tiers:- Tier 1: full story cards with proof obligations + new/changed scenario cards
- Tier 2: impacted scenario cards + their current test results
- Tier 3: sentinel scenario IDs + baseline results + current results
- Wrap in competitive framing from
skills/shared/par-reviewer-wrapper.md - Dispatch TWO auditor subagents in parallel
- Wait for both to return
3. Aggregate findings
Following PAR aggregation rules:
- Same finding from both auditors → one finding, high confidence
- Finding from only one auditor → separate finding, still actionable
- Severity disagreement → take the more severe assessment, always fix it
4. Process results
- If gaps found (any AC fails, evidence is too weak, sentinel regression detected):
- For AC failures: append gap stories to
requirements/(statuspending) or flip existing stories back fromdonetopending - For weak evidence: create evidence-improvement stories (add scenario, strengthen seam)
- For sentinel regressions: create regression-fix stories with CRITICAL priority
- Revise
roadmap.mdto add a follow-up iteration for the gaps
- For AC failures: append gap stories to
- If clean (all tiers pass, evidence is adequate):
- The iteration is confirmed done
- Return clean signal to the orchestrator
5. Return control
Return the audit result (clean or gaps) to the orchestrator. The orchestrator decides whether to loop or terminate.
Quick Reference
| Tier | What it checks | Failure means |
| Deep evidence | Every AC + proof obligation for current iteration | Story not done, evidence too weak |
| Impacted behavior | Scenarios whose surfaces were touched | Stale or broken scenario |
| Sentinel corpus | High-value journey scenarios | Regression in previously-working behavior |
| Reads | Writes | Dispatches |
requirements/, behavior-scenarios.md, behavior-corpus.md, product code/tests | requirements/ (gaps), roadmap.md (new iteration) if gaps, behavior-scenarios.md (stale flags) | Two auditor subagents in parallel (PAR) |
References
skills/shared/parallel-adversarial-review.md— PAR methodologyskills/shared/par-reviewer-wrapper.md— competitive framing wrapperskills/shared/behavior-evidence-formats.md— scenario and proof obligation formatsauditor-subagent-prompt.md— auditor-specific prompt template
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

