test-value-audit
Skill1 starsChanged 51 days agoMITView on GitHub
Audit tests for distinct defect-detection value relative to their maintenance cost, reading tests alongside production code. Identify redundant or ineffective tests and meaningful coverage gaps. Never edit production code; change tests only when explicitly requested.
2 other projects use a version of this.
Adopted by
Most recently taken up by
- samuelhe52/agent-skillsword for word, first seen Sep 22, 2026
- 0xrohan10/skillstheir own version, first seen Jul 22, 2026
Other versions2 projects use a version of this.
Word for word · 1
- samuelhe52/agent-skills★ 1100% same
Edited · 0
None found.
Wrote their own version · 1
- 0xrohan10/skills★ 2same name
How matches are found. Word for word: the exact same text. Edited: shares passages with this file (“99% same” means 99% of its five-word phrases also appear here; 10% or more counts). Their own version: similar meaning, or, weakest, the same name. We can’t tell which project had it first. Projects are counted among the 200 most-starred candidates, and mentions are links to the repository we found, up to 50 per site, so both counts are a floor.
In this repository5 other files it gives its agents.
- experiment-infra-designSkill
- html-slidesSkill
- paper-summarizationSkill
- paper-walkthrough-slidesSkill
- remote-gpu-experimentsSkill
The file
We split this skill into the rules it gives an agent
4 rules. About 0 are common, 4 are distinctive, and 0 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈4
Distinctive · estimate
This author's own choices. Worth a look.
0
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 18
Check whether assertions actually run and whether the test can fail for the intended reason.
- Distinctive: line 36
Look for missing protection as well as opportunities to simplify.
- Distinctive: line 38
Prefer extending an existing test when it can clearly express the missing contract.
- Distinctive: line 50
Never edit production code.
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Test Value Audit
Assess which plausible regressions a test detects and whether that protection justifies its maintenance cost. Read tests alongside the behavior they exercise and the requirements they are meant to protect.
When proposing or writing a test, identify the observable contract, a credible regression that would make the test fail, and why existing tests would not catch it. Prefer extending an existing test when it can express the distinct risk clearly. Question a production seam introduced only to support a weak test.
Assess the protection
Identify the contract, the plausible defect, and how the test would expose that defect. Useful protection can cover ordinary business behavior, boundary conditions, failure handling, or interactions between components. Choose the relevant dimensions for the code under review.
Judge a test by whether a consequential defect would cause it to fail. Its expected result should express the intended contract independently enough to expose an incorrect implementation. Assertions that merely reproduce the implementation or confirm a configured mock response offer little evidence of correctness.
Check whether assertions actually run and whether the test can fail for the intended reason. A swallowed assertion or an unawaited asynchronous check can make apparent coverage ineffective.
Inspect tests whose expected values come from the code under test, mocks that supply the asserted behavior, and negative cases that pass because of an unrelated guard. These patterns can hide a regression; determine whether the test has independent protection before changing it.
Assess redundancy by the defects detected, not by similar syntax or shared line coverage. Tests exercising the same code may protect different behavior. Tests with different fixtures may provide interchangeable protection.
Distinguish stable behavioral requirements from replaceable implementation choices. An internal API can still embody an important contract; being internal is not itself a reason to remove its tests.
Weigh cost and redundancy
Treat implementation coupling, broad snapshots, and many similar cases as prompts for investigation rather than automatic removal criteria. Determine what protection would be lost before simplifying. A compact test with weak assertions can be less valuable than a longer integration test that detects a distinct failure.
Include setup, brittleness, runtime, mocks, and production complexity introduced for testing in the cost assessment. Isolation is useful when it preserves the behavior under examination. Question mocks that remove that behavior or conceal the failure the test is supposed to detect.
Mocking an external dependency can make a test deterministic; mocking the behavior being tested can make it circular. Evaluate the boundary and the asserted outcome rather than counting mocks. Keep production seams that serve architectural purposes as well as testing, and question complexity introduced solely to support weak tests.
Find gaps and choose changes
Look for missing protection as well as opportunities to simplify. Recommend adding or strengthening a test when it covers a meaningful risk that the existing suite does not detect. Choose additional investigation or test execution according to what would resolve uncertainty in the assessment.
Prefer extending an existing test when it can clearly express the missing contract. Use coverage, mutation testing, or failure history when they would resolve an important uncertainty; avoid making them mandatory for a straightforward review.
For a bug regression test, seek evidence that it fails on the faulty behavior for the intended reason and passes with the fix. If that check is impractical, state what supports the test and what remains unverified.
Merge tests when their protection is interchangeable and can be retained more simply. Rewrite a test when its intended contract matters but its setup or assertions do not establish it. Before recommending removal, identify the failure the test can detect, any remaining test that detects it, and the protection that would be lost. Check relevant history when the test's purpose is unclear. Remove one only when the lost protection is unnecessary or adequately supplied elsewhere.
Report and scope
Recommend keeping, merging, removing, rewriting, or adding tests as appropriate, with evidence and a clear account of the protection gained or lost. Prioritize consequential findings and choose a report structure suited to the scope.
Cite the test and relevant production behavior, explain non-obvious recommendations, and distinguish confirmed findings from uncertainties. Report meaningful coverage gaps without enumerating every routine keep.
Never edit production code. Change tests only when explicitly requested; report possible production simplifications as recommendations.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

