agentleFS
epicsagasepicsagas/epic-harness/skills/audit/SKILL.md

audit

Skill20 starsChanged 2 months agoApache-2.0View on GitHub

Audit phase. Parallel review: code quality + security + tests. Semantic dedup of cross-mode findings. Outputs PASS/WARN/FAIL per dimension. Validates spec coverage.

  • Reads credentials

194 other projects use a version of this.

Adopted by

Most recently taken up by

Used with

Projects with it also use delight, teach-impeccable and 10 more.

Other files people use alongside this one.

Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
  • HK-hubSkill

    delight

    Add moments of joy, personality, and unexpected touches that make interfaces memorable and enjoyable to use. Elevates functional to delightful. Use when the user asks to add polish, personality, animations, micro-interactions, delight, or make an interface feel fun or memorable.

    Also in 32 projects that use this

  • HK-hubSkill

    teach-impeccable

    One-time setup that gathers design context for your project and saves it to your AI config file. Run once to establish persistent design guidelines.

    Also in 19 projects that use this

  • zwy123zwySkill

    normalize

    将用户随意输入的提示词规范化为结构清晰、便于大模型执行的标准化提示词。适用于需要整理、统一提示词格式时调用。

    Also in 19 projects that use this

  • SkillPilotCHSkill

    level-up

    Eine Automatisierung pro Woche finden, scopen, shippen. Output landet als proposed-Eintrag in cadence.md mit konkreten Implementations-Schritten.

    Also in 12 projects that use this

  • ww-w-aiSkill

    pm-discovery

    PM Agent Team - Automated product discovery, strategy, and PRD generation. Runs PM analysis workflow to produce comprehensive PRD before PDCA Plan phase.

    Also in 3 projects that use this

  • +7 more from HK-hub

The file

Show its rules and text

We split this skill into the rules it gives an agent

16 rules. 0 are common, 10 are distinctive, and 6 are very specific to this project.

  • 0

    Common

    Most of the 175 edited versions we read keep these.

  • 10

    Distinctive

    This author's own choices. Worth a look.

  • 6

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Very specific:

    CRITICAL: Run HARNESS_DIR=$(epic path) first.

    line 8
  2. Very specific:

    When invoked with --strict (or when .harness/engagement.md has mode: strict), the audit enforces independence between verification agents …

    line 20
  3. Distinctive:

    Blind scoring: No mode can see another mode's verdict until synthesis.

    line 24
  4. Very specific:

    No self-review: If the same agent built the code (via /go), a different agent instance must run audit.

    line 25
  5. Very specific:

    Use --strict for security-sensitive projects, compliance requirements, or when the build phase had ambiguous outcomes.

    line 27
  6. Distinctive:

    Read the Requirements and Acceptance Criteria sections.

    line 44
  7. Very specific:

    --strict isolation protocol: When strict mode is active, each mode agent must be launched with:

    line 72
  8. Distinctive:

    Only the diff output from Step 1 as input (no session context)

    line 73
  9. Distinctive:

    No access to other modes' intermediate or final results

    line 74
  10. Distinctive:

    Naming: Do names clearly convey intent?

    line 93
  11. Distinctive:

    Diff minimality: Every hunk traces to a Requirement.

    line 95
  12. Very specific:

    Always check .env files are in .gitignore

    line 117
  13. Distinctive:

    Run the full test suite

    line 156
  14. Distinctive:

    Verify each Acceptance Criterion is demonstrably met

    line 157
  15. Distinctive:

    After all 3 modes complete, merge their findings and deduplicate:

    line 165
  16. Distinctive:

    Output: Only deduplicated findings proceed to Step 4 synthesis.

    line 181

“Common” is measured: kept by at least 6 in 10 of the 175 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Audit — Verify Everything

CRITICAL: Run HARNESS_DIR=$(epic path) first. NEVER use .harness/ in the project directory.

Execution Modes

This skill has 3 internal modes that run in parallel:

  1. audit:code — Code quality, logic, style, test coverage, spec coverage
  2. audit:security — OWASP Top 10 + performance (N+1, leaks)
  3. audit:test — Full test suite, AC verification, coverage delta

--strict Mode (Trust Boundary Isolation)

When invoked with --strict (or when .harness/engagement.md has mode: strict), the audit enforces independence between verification agents to prevent reward hacking:

  • Artifact-only delivery: Each mode receives only the code diff and spec — no builder context, no session history, no prior agent conclusions.
  • Cross-check independence: audit:code and audit:security run without visibility into each other's findings. Results are combined only during synthesis (Step 4).
  • Blind scoring: No mode can see another mode's verdict until synthesis. This prevents anchoring bias where a clean code review inflates the security score.
  • No self-review: If the same agent built the code (via /go), a different agent instance must run audit. The builder's session ID is checked and excluded.

Use --strict for security-sensitive projects, compliance requirements, or when the build phase had ambiguous outcomes.


Process

Step 0: Prerequisites

Confirm go has run:

git symbolic-ref --short HEAD  # must NOT be main/master

Load the spec to know what was supposed to be built:

ls -t $HARNESS_DIR/specs/SPEC-*.md | head -1

Read the Requirements and Acceptance Criteria sections.

Step 1: Gather Scope

git diff --stat $(git merge-base HEAD main)
git diff --name-only $(git merge-base HEAD main)
git diff --numstat $(git merge-base HEAD main)

Over-edit signal. From --numstat, flag any file whose added+removed lines exceed 100 while the spec has 2 or fewer Requirements, or any file the spec never mentions. Flagged files get the Diff minimality check in audit:code. Typical cause: a formatter the project never adopted rewrote the whole file (quote style, line wrapping, import splitting).

Step 2: Scope Detection

PatternScopeExtra checks
*.api.*, *route*, *controller*, *handler*API+ Contract testing, request validation
*.tsx, *.jsx, *.vue, *.svelte, *.cssFrontend+ Accessibility, semantic HTML
*.sql, *migration*, *schema*Database+ Migration safety, rollback plan
*.rs, Cargo.toml, *.go, go.modBackend+ Build verification, type safety
*.test.*, *.spec.*, __tests__/Tests+ Coverage delta, flaky test detection
Dockerfile*, *.yml, *.yaml, MakefileInfra+ Config validation, secret detection
*.md, *.txtDocs+ Link checking, freshness

Step 3: Run Checks in Parallel

Launch all 3 modes with run_in_background: true.

--strict isolation protocol: When strict mode is active, each mode agent must be launched with:

  • Only the diff output from Step 1 as input (no session context)
  • No access to other modes' intermediate or final results
  • A fresh context window containing only: spec, diff, and the mode-specific checklist

This ensures each mode forms independent conclusions. Results are combined only in Step 4 synthesis.


Mode: audit:code (Review)

Constraints

  • Be specific — cite file and line number for every finding
  • Suggest fixes, don't just flag problems — every finding needs a one-line fix hint

Review Dimensions

  1. Correctness: Does the code do what it claims? Edge cases handled?
  2. Logic: Race conditions, off-by-one, null pointer risks?
  3. Style: Consistent with project conventions? Readable?
  4. Tests: Changes covered by tests? Tests meaningful?
  5. Naming: Do names clearly convey intent?
  6. Spec coverage: Each Requirement addressed in the diff?
  7. Diff minimality: Every hunk traces to a Requirement. Hunks that only reformat, re-wrap, re-quote, or reorder untouched code are WARN; list them and revert before ship.

Output Format

## Code Review: <file or area>
- [BLOCKER] <description> (line X)
- [WARN] <description> (line Y)
- [NIT] <description> (line Z)

## Summary
- Blockers: N
- Warnings: N
- Verdict: APPROVE / REQUEST_CHANGES

Mode: audit:security (Security)

Constraints

  • False positives are better than false negatives for security
  • Always check .env files are in .gitignore

Security Checklist (OWASP Top 10)

  1. Injection (SQL, XSS, command)
  2. Broken authentication
  3. Sensitive data exposure
  4. Access control failures
  5. Security misconfiguration

Performance Checklist

  1. N+1 queries
  2. Unbounded data loading
  3. Missing indexes
  4. Memory leaks (event listeners, growing caches)
  5. Blocking main thread

Output Format

## Security Audit
- [CRITICAL] SQL injection risk in <file>:<line>
- [HIGH] Hardcoded secret in <file>:<line>
- [MEDIUM] Missing rate limit on <endpoint>

## Performance Audit
- [HIGH] N+1 query in <file>:<line>
- [MEDIUM] Unbounded array growth in <file>:<line>

## Summary
- Security: PASS / FAIL (N critical, N high)
- Performance: PASS / WARN (N issues)

Mode: audit:test (Test Runner)

  1. Run the full test suite
  2. Verify each Acceptance Criterion is demonstrably met
  3. Report coverage delta
  4. Flag any flaky tests

Step 3.5: Semantic Deduplication

After all 3 modes complete, merge their findings and deduplicate:

Collection: Gather all findings from code, security, and test modes into a single pool.

Root-Cause Grouping: For each finding, identify the root cause. Findings sharing the same root cause (same file, same function, same underlying pattern) form a group.

Classification (per group):

ClassificationMeaningAction
NEWFirst finding for this root causeInclude in report
DUP_BETTERDuplicate with better evidence or higher severityReplace original with this
DUP_SKIPDuplicate with weaker or equal evidenceDrop; reference the NEW finding

Severity Reassessment: The surviving finding in each group takes the highest severity across all modes. For example, if code review says [WARN] but security says [CRITICAL] for the same root cause, the deduped finding is [CRITICAL].

Output: Only deduplicated findings proceed to Step 4 synthesis. The report should note: "N findings deduplicated from M total (K groups collapsed)."


Step 4: Synthesize

Combine deduplicated findings into a single report:

## Audit Report
- Spec: SPEC-{timestamp} ({goal_slug})
- Branch: {current branch}

### Change Scope
- Scopes detected: [API, Frontend, Backend, Database, Infra, Docs, Tests]
- Scope-specific checks: [list what ran]

### Code Quality: [PASS/WARN/FAIL]
### Security: [PASS/WARN/FAIL]
### Performance: [PASS/WARN/FAIL]
### Tests: [X/Y passing, Z% coverage]

### Deduplication
- Total findings: M
- Deduplicated: N (K groups collapsed)

### Spec Coverage
- R1: ✅/❌ addressed in diff
- R2: ✅/❌ addressed in diff
- AC1: ✅/❌ verified by test
- AC2: ✅/❌ verified by test

### Action Items
1. [blocker or warning]

Step 5: Act

  • All PASS + all AC verified: "Audit passed. Run /ship to create a PR."
  • WARN: Show warnings, ask if user wants to fix before shipping
  • FAIL or AC missing: List each blocker with a one-line fix hint. "Fix with /go, then re-run /audit."

Anti-Rationalization

ExcuseRebuttalWhat to do instead
"It's a small change, skip security"Small changes introduce big vulnerabilitiesAlways run the security checklist
"Tests are passing, that's enough"Tests don't catch security or performance issuesRun all 3 modes
"I'll fix the warnings later"Later never comesFix blockers now, warnings before merge
"Dedup is overkill for small audits"Small audits can still have cross-mode overlapAlways dedup — the cost is trivial
"Strict mode is overkill"Without isolation, the builder can influence reviewers via shared contextUse --strict for security-sensitive or compliance-driven projects
"The agents are independent enough"Shared context creates anchoring bias — a clean code review inflates security scoresStrict mode ensures blind scoring until synthesis

Evidence Required

  • All 3 modes (code, security, test) completed
  • Each Requirement has a coverage verdict
  • Each AC has a test/verification verdict
  • No BLOCKER items remain on PASS
  • Deduplication applied: total vs. deduplicated count reported

Red Flags

  • Skipping security review for "small changes"
  • Approving code with failing tests
  • Ignoring performance warnings in hot paths
  • Marking audit PASS when any AC is unverified
  • Reporting raw findings without deduplication

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.