agentleFS
openclawopenclaw/openclaw-enterprise/.agents/skills/test-audit/SKILL.md

test-audit

Skill454 starsChanged 6 days agoMITView on GitHub

Gate new or changed Enterprise tests and audit existing tests for observable behavior, credible regressions, duplicate coverage, and test-only production seams.

80 other projects use a version of this.

Adopted by

Most recently taken up by

Used with

Projects with it also use chips, redo and 8 more.

Other files people use alongside this one.

Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
  • udecodeSkill

    chips

    Run the project's suggested-task ledger, the chips. /chips alone brings this session's open tasks up to date: it applies what the ledger helper says, settles stale and split tasks, cards what can start and reports the board, and /chips all also takes the ship-list tasks and the ones no live session owns, and merges duplicate tasks across the board. Use for /chips, /chips offer, start or drop, \"what chips are open\", \"suggest a task for X\", \"update the chips\", \"clean up the chips\", \"which chips are stale\", \"is this chip still worth doing\", \"merge duplicate chips\", at the last hand-back of a run that offered a task, and whenever pstack would file a tracked issue, a follow-up, a reflect Backlog item or an out-of-band PR.

    Also in 3 projects that use this

  • Scylla23Skill

    redo

    Re-run the last routed task one model tier up (haiku → sonnet → opus → fable). User-invoked escalation when the previous result missed. Pass --dry-run to preview without running.

    Also in 3 projects that use this

  • Aetheria-Labs1Skill

    plan-page

    Plan one storefront page from strategy through final copy, section order, proof, offers, template direction, responsive layout, and production asset requirements. Stops at an approved execution-ready specification.

    Also in 3 projects that use this

  • SocialKit-APISkill

    video-transcripts

    Extract transcripts from social videos through SocialKit across YouTube, TikTok, Instagram, Facebook, X/Twitter, LinkedIn, and direct video file URLs. Use when the user asks to transcribe, get captions or subtitles, pull the spoken text, or read what a video says, including one video or many at once. Returns full text plus timestamped segments. Not for posting, private accounts, or unrelated website scraping.

    Also in 3 projects that use this

  • clawdbotSkill

    pr-simplify

    Simplify your own change to its smallest complete fix. Use before opening a PR, before pushing large repairs to one, or when asked to shrink a PR or clean up slop.

    Also in 3 projects that use this

  • spitoglouSkill

    technical-documentation

    Create and improve technical documentation including architecture designs, PRDs, API docs, code explanations, and visual diagrams. Use when asked to document systems, explain codebases, create design documents, write PRDs, generate Mermaid/PlantUML diagrams, review architecture, write user stories, or create pull request descriptions. Triggers include "document this", "create a design doc", "explain this code", "write a PRD", "create a diagram", "architecture overview", "user story for", "PR description".

    Also in 3 projects that use this

The file

We split this skill into the rules it gives an agent

10 rules. 0 are common, 10 are distinctive, and 0 are very specific to this project.

  • 0

    Common

    Most of the 77 edited versions we read keep these.

  • 10

    Distinctive

    This author's own choices. Worth a look.

  • 0

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Use the authoring gate when writing or changing tests.

    line 8
  2. Distinctive:

    Read repository test integrity rules first.

    line 10
  3. Distinctive:

    Use fixture and scenario conventions when extracting reusable setup, builders, or contract suites.

    line 11
  4. Distinctive:

    Before adding a test, answer all four questions:

    line 17
  5. Distinctive:

    Read the complete candidate test, production owner, callers, overlapping tests, relevant history, and CI selection.

    line 34
  6. Distinctive:

    Look for assertion-free probes, self-comparisons, source-string assertions, copied inventories, duplicate contract invocations, private …

    line 38
  7. Distinctive:

    Before deleting or rewriting a candidate, record:

    line 50
  8. Distinctive:

    Keep uncertain candidates and explain why.

    line 57
  9. Distinctive:

    Use enterprise-testing to choose the smallest real proof.

    line 64
  10. Distinctive:

    After audit edits, use deslop for behavior-neutral cleanup before requested autoreview.

    line 81

“Common” is measured: kept by at least 6 in 10 of the 77 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Test Audit

Use the authoring gate when writing or changing tests. For a requested audit, inspect the selected scope before proposing edits; keep each batch coherent. Read repository test integrity rules first. Use fixture and scenario conventions when extracting reusable setup, builders, or contract suites. Keep expected outcomes independent of the implementation and resource ownership explicit.

Authoring gate

Before adding a test, answer all four questions:

  1. What observable behavior, invariant, or independent contract does it protect?
  2. What credible regression makes it fail?
  3. Why does existing coverage not already catch that failure? Prefer extending an existing case or fixture over duplicating the same proof.
  4. Does it need an export, flag, wrapper, or injection hook that no production caller needs? If so, test at the real owning boundary instead.

A missing answer means the test is not ready. Demonstrate that a bug regression test fails on the pre-fix implementation for the intended reason and passes with the repair. If that comparison cannot run, report the gap rather than claiming the regression was proved. Do not replace real behavior with a self-fulfilling mock or copy application logic into a fixture.

Audit and retention

Read the complete candidate test, production owner, callers, overlapping tests, relevant history, and CI selection. Inspect the dependency contract when the test claims dependency-backed behavior.

Look for assertion-free probes, self-comparisons, source-string assertions, copied inventories, duplicate contract invocations, private call-shape assertions, and exports or wrappers retained only for tests. These are candidates, not automatic deletions. A test that fails after behavior-preserving refactoring may need to move to a stable boundary.

Retain independent API, Driver, storage, security, configuration, protocol, packaging, generated-artifact, or architecture contract checks. Observable call ordering and credible regressions remain valuable. Static or slow tests are not low-value merely because of their form; source inspection can be an independent guard, but checking a SQL string does not prove database behavior.

Before deleting or rewriting a candidate, record:

  • Exact test name and path, and the failure it can detect.
  • Non-test callers of any covered production seam.
  • Stronger remaining proof, or why the behavior no longer needs coverage.
  • Relevant history, intended simplification, risk, and focused validation command.

Keep uncertain candidates and explain why. Within the authorized audit scope, remove confirmed obsolete test-only seams with their tests; do not preserve aliases or add new production seams to replace them. Optimize confidence rather than deletion counts. Report potential product changes separately.

Validate and hand off

Use enterprise-testing to choose the smallest real proof. Run commands from the repository root, for example:

node --test tests/conformance/contracts.test.mjs
node --test tests/integration/console-api.test.ts
git diff --check

Select actual owner/sibling files for the change; the examples are not mandatory targets. Use pnpm test:conformance or pnpm test:integration when broader contracts warrant them. Persistence and runtime claims require the existing PostgreSQL, Docker, or Kubernetes procedures. Do not edit inputs while tests run. Retain integration-test comments that explain intent and invariants.

After audit edits, use deslop for behavior-neutral cleanup before requested autoreview. Report changed candidates, retained false positives, production versus test changes, exact proof and skips, and unresolved gaps. Follow contribution rules for authorized commits and PRs; an audit does not authorize a merge or another workstream.

Provenance

Adapted from OpenClaw; see source and intentional adaptations.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.