agentleFS
prime-radiant-incprime-radiant-inc/iterative-development/skills/auditing-progress/SKILL.md

auditing-progress

Skill179 starsChanged 7 months agoApache-2.0View on GitHub

Use when an iteration has just finished and you need to verify behavior evidence quality in three tiers — deep evidence for current stories, impacted behavior for touched scenarios, and sentinel corpus for high-value regression detection.

The file

We split this skill into the rules it gives an agent

4 rules. About 0 are common, 2 are distinctive, and 2 are very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈2

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 2

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Very specific:

    Read the per-epic requirement files in docs/superpowers/iterations/requirements/, docs/superpowers/iterations/behavior-scenarios.md, and …

    line 22
  2. Distinctive:

    Tier 2 — Impacted behavior: all existing scenarios whose owning stories had code changes in this iteration (even if those stories were …

    line 25
  3. Very specific:

    Tier 3 — Sentinel corpus: all scenarios with run cadence sentinel in the behavior corpus.

    line 26
  4. Distinctive:

    Wait for both to return

    line 38

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Auditing Progress

Overview

Runs after every iteration as part of the planning cycle. Verifies behavior evidence quality in three tiers using parallel adversarial review (PAR) — two paired auditor subagents evaluate the same work in parallel with competitive framing.

The audit answers: "Does durable, reusable evidence exist at the correct seam for every externally observable behavior this iteration touched?"

When to Use

Invoked by iterative-development after every running-an-iteration call, before picking the next iteration.

Audit Process

1. Partition the audit into three tiers

Read the per-epic requirement files in docs/superpowers/iterations/requirements/, docs/superpowers/iterations/behavior-scenarios.md, and docs/superpowers/iterations/behavior-corpus.md:

  • Tier 1 — Deep evidence: stories marked done:ITER-<current> and scenarios added or updated in this iteration. Audit every AC and its proof obligation thoroughly.
  • Tier 2 — Impacted behavior: all existing scenarios whose owning stories had code changes in this iteration (even if those stories were completed in earlier iterations). Verify the scenarios still pass.
  • Tier 3 — Sentinel corpus: all scenarios with run cadence sentinel in the behavior corpus. Compare against the pre-iteration baseline from running-an-iteration step 3.

2. Dispatch paired auditor subagents (PAR)

Following the PAR methodology in skills/shared/parallel-adversarial-review.md:

  1. Build the auditor prompt using auditor-subagent-prompt.md. Include ALL THREE tiers:
    • Tier 1: full story cards with proof obligations + new/changed scenario cards
    • Tier 2: impacted scenario cards + their current test results
    • Tier 3: sentinel scenario IDs + baseline results + current results
  2. Wrap in competitive framing from skills/shared/par-reviewer-wrapper.md
  3. Dispatch TWO auditor subagents in parallel
  4. Wait for both to return

3. Aggregate findings

Following PAR aggregation rules:

  • Same finding from both auditors → one finding, high confidence
  • Finding from only one auditor → separate finding, still actionable
  • Severity disagreement → take the more severe assessment, always fix it

4. Process results

  • If gaps found (any AC fails, evidence is too weak, sentinel regression detected):
    • For AC failures: append gap stories to requirements/ (status pending) or flip existing stories back from done to pending
    • For weak evidence: create evidence-improvement stories (add scenario, strengthen seam)
    • For sentinel regressions: create regression-fix stories with CRITICAL priority
    • Revise roadmap.md to add a follow-up iteration for the gaps
  • If clean (all tiers pass, evidence is adequate):
    • The iteration is confirmed done
    • Return clean signal to the orchestrator

5. Return control

Return the audit result (clean or gaps) to the orchestrator. The orchestrator decides whether to loop or terminate.

Quick Reference

TierWhat it checksFailure means
Deep evidenceEvery AC + proof obligation for current iterationStory not done, evidence too weak
Impacted behaviorScenarios whose surfaces were touchedStale or broken scenario
Sentinel corpusHigh-value journey scenariosRegression in previously-working behavior
ReadsWritesDispatches
requirements/, behavior-scenarios.md, behavior-corpus.md, product code/testsrequirements/ (gaps), roadmap.md (new iteration) if gaps, behavior-scenarios.md (stale flags)Two auditor subagents in parallel (PAR)

References

  • skills/shared/parallel-adversarial-review.md — PAR methodology
  • skills/shared/par-reviewer-wrapper.md — competitive framing wrapper
  • skills/shared/behavior-evidence-formats.md — scenario and proof obligation formats
  • auditor-subagent-prompt.md — auditor-specific prompt template

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.