agentleFS
nesnilnehcnesnilnehc/ai-cortex/skills/review-testing/SKILL.md

review-testing

Skill8 starsChanged 2 months agoMITView on GitHub

Review changed behavior and tests against the canonical testing quality Rule set, including direct oracles, boundary paths, integration assembly, contracts, determinism, doubles and coverage evidence.

6 other projects use a version of this.

Adopted by

Most recently taken up by

The file

We split this skill into the rules it gives an agent

7 rules. 0 are common, 7 are distinctive, and 0 are very specific to this project.

  • 0

    Common

    Most of the 4 edited versions we read keep these.

  • 7

    Distinctive

    This author's own choices. Worth a look.

  • 0

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Test-quality review for a change or repository area

    line 28
  2. Distinctive:

    Use existing test reports when available, but do not infer adequate oracles from a green run or aggregate coverage alone.

    line 37
  3. Distinctive:

    Do not restate the test checklist in this Skill.

    line 47
  4. Distinctive:

    Do not count a test file or executed line as a valid behavioral oracle by itself.

    line 48
  5. Distinctive:

    Do not run full test suites or create tests unless another invoked Skill authorizes it.

    line 49
  6. Distinctive:

    Do not mark environment-blocked evidence as passed.

    line 50
  7. Distinctive:

    Do not report the production defect itself.

    line 51

“Common” is measured: kept by at least 6 in 10 of the 4 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Skill: Review Testing

Purpose

Evaluate changed production behavior and its tests against testing-quality, while applying standards-test-code to test-file construction. Emit findings-list output with category cognitive-testing.

Core objective

Determine whether the test system would detect missing, incorrect and boundary behavior in the supplied scope, not merely whether tests or line coverage exist.

Success requires traceability from changed behavior to discriminating assertions, execution-boundary evidence where applicable, independent contract oracles, one outcome per Rule item and a Rule ID in every finding.

Scope boundaries

This Skill reviews test adequacy and design. It does not run tests as its primary capability, select scope, review production architecture/security/performance, write tests, or repair failures. Use automate-tests for execution and orchestrate-repair-loop for fixes.

Use cases

  • Test-quality review for a change or repository area
  • The testing cognitive step in orchestrate-code-review
  • Review of public-contract, integration-boundary or critical-path evidence

Behavior

  1. Load testing-quality, standards-test-code and record versions where present.
  2. Resolve profiles, coverage policy and waivers from project configuration and the changed behavior.
  3. Build a behavior-to-test map. Inspect assertions, boundary/error cases, production composition, contract fixtures, determinism controls and test doubles.
  4. Use existing test reports when available, but do not infer adequate oracles from a green run or aggregate coverage alone.
  5. Emit one finding per failed Rule item with category cognitive-testing and a fully qualified TST ID.
  6. Return Rule coverage using the exact passed, waived, not_applicable and evidence_limited fields from the findings-list Spec.

Input and output

Input is selected production and test code. Output follows findings-list; descriptions cite testing-quality@<version>/<TST-ID>.

Restrictions

  • Do not restate the test checklist in this Skill.
  • Do not count a test file or executed line as a valid behavioral oracle by itself.
  • Do not run full test suites or create tests unless another invoked Skill authorizes it.
  • Do not mark environment-blocked evidence as passed.
  • Do not report the production defect itself. This Skill reports only that nothing would have caught it; the concern Skill that owns the defect reports the defect and carries its severity.

Self-Check

  • Canonical testing and test-code Rules were loaded.
  • Changed behaviors were mapped to discriminating assertions.
  • Every applicable TST item has a pass, finding, valid waiver or evidence limitation.
  • Findings are precise and cite Rule IDs.
  • Green tests and aggregate coverage were not overinterpreted.

Examples

Example 1: built but not wired

Unit tests instantiate a new handler directly, but production registration is absent. Emit a TST-003 finding at the integration boundary; architecture review may separately raise ARC-008.

Example 2: line coverage without an oracle

A branch executes but no assertion distinguishes the required outcome. Emit a TST-001 finding; do not accept the coverage percentage as proof.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.