agentleFS
lithammerlithammer/ai/skills/test-audit/SKILL.md

test-audit

Skill0 starsChanged 52 days agoMITView on GitHub

Find tests that do not earn their upkeep and silent regressions nothing guards, then apply the chosen changes.

80 other projects use a version of this.

Adopted by

Most recently taken up by

Used with

Projects with it also use chips, redo and 10 more.

Other files people use alongside this one.

Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
  • udecodeSkill

    chips

    Run the project's suggested-task ledger, the chips. /chips alone brings this session's open tasks up to date: it applies what the ledger helper says, settles stale and split tasks, cards what can start and reports the board, and /chips all also takes the ship-list tasks and the ones no live session owns, and merges duplicate tasks across the board. Use for /chips, /chips offer, start or drop, \"what chips are open\", \"suggest a task for X\", \"update the chips\", \"clean up the chips\", \"which chips are stale\", \"is this chip still worth doing\", \"merge duplicate chips\", at the last hand-back of a run that offered a task, and whenever pstack would file a tracked issue, a follow-up, a reflect Backlog item or an out-of-band PR.

    Also in 3 projects that use this

  • Scylla23Skill

    redo

    Re-run the last routed task one model tier up (haiku → sonnet → opus → fable). User-invoked escalation when the previous result missed. Pass --dry-run to preview without running.

    Also in 3 projects that use this

  • Aetheria-Labs1Skill

    plan-page

    Plan one storefront page from strategy through final copy, section order, proof, offers, template direction, responsive layout, and production asset requirements. Stops at an approved execution-ready specification.

    Also in 3 projects that use this

  • SocialKit-APISkill

    video-transcripts

    Extract transcripts from social videos through SocialKit across YouTube, TikTok, Instagram, Facebook, X/Twitter, LinkedIn, and direct video file URLs. Use when the user asks to transcribe, get captions or subtitles, pull the spoken text, or read what a video says, including one video or many at once. Returns full text plus timestamped segments. Not for posting, private accounts, or unrelated website scraping.

    Also in 3 projects that use this

  • clawdbotSkill

    pr-simplify

    Simplify your own change to its smallest complete fix. Use before opening a PR, before pushing large repairs to one, or when asked to shrink a PR or clean up slop.

    Also in 3 projects that use this

  • spitoglouSkill

    technical-documentation

    Create and improve technical documentation including architecture designs, PRDs, API docs, code explanations, and visual diagrams. Use when asked to document systems, explain codebases, create design documents, write PRDs, generate Mermaid/PlantUML diagrams, review architecture, write user stories, or create pull request descriptions. Triggers include "document this", "create a design doc", "explain this code", "write a PRD", "create a diagram", "architecture overview", "user story for", "PR description".

    Also in 3 projects that use this

The file

We split this skill into the rules it gives an agent

6 rules. 0 are common, 5 are distinctive, and 1 is very specific to this project.

  • 0

    Common

    Most of the 77 edited versions we read keep these.

  • 5

    Distinctive

    This author's own choices. Worth a look.

  • 1

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Read the repository's instructions and the requested scope or concern: a path, subsystem, or kind of test.

    line 17
  2. Distinctive:

    Run the in-scope tests and static checks.

    line 21
  3. Distinctive:

    Use a single agent by default.

    line 27
  4. Distinctive:

    Read each test beside the production code it guards.

    line 30
  5. Distinctive:

    Wait for the user to select candidates before editing.

    line 72
  6. Very specific:

    Use the develop skill for the selected candidates.

    line 76

“Common” is measured: kept by at least 6 in 10 of the 77 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Test Audit

Audit existing tests with one question: if the behavior a test guards broke, what would notice first? A test earns its upkeep only when nothing else would: the regression is silent, and an incidental edit, made while changing nearby code for another reason, could cause it. No diff is needed.

1. Scope

Read the repository's instructions and the requested scope or concern: a path, subsystem, or kind of test. With no target, map the repository's major subsystems and choose promising areas to inspect.

Run the in-scope tests and static checks. A test that is already red may guard a product bug; report it and leave its value unjudged. The proofs in step 3 need a green baseline.

2. Discover

Use a single agent by default. Split a large scope only along genuinely independent subsystems.

Read each test beside the production code it guards. For each guarded behavior, ask what would notice a regression first: types, another test, a crash, a visible failure in normal use, or nothing. Collect candidates in both directions:

  • Removal: a test whose regression something else would catch, or that goes red when behavior stays the same.
  • Addition: behavior whose regression nothing would catch, where a incidental edit could cause it.

3. Prove

Record git status --short and git diff before the first mutation. Prove each candidate with a mutation of the production code, then run the owner's tests, static checks, and, where the claim is normal use, a real run. Undo each mutation before the next.

  • Break the guarded behavior and something other than the test goes red: the test is redundant.
  • Change the code without changing behavior and the test goes red: the test is a change detector.
  • Break the behavior and nothing goes red: propose a test.

Record each mutation and what caught it. A claim the environment cannot run stays unproven; drop it with the candidates the proof does not support.

Done when every remaining candidate has a mutation record and the working tree matches the record taken before the first mutation.

4. Present and wait

Rank candidates by upkeep removed or risk guarded. For each, give:

  • The test or production location and the behavior it concerns.
  • The mutation, and what caught it or that nothing did.
  • For a removal, the lines it removes, including production code that only the test uses.
  • For an addition, the contract and the edit that would break it.

State what you explored and what remains unread. Return no candidates when none hold.

Wait for the user to select candidates before editing.

5. Implement

Use the develop skill for the selected candidates. Pass each candidate's mutation record as its requirements; a selected addition is the user asking for that test.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.