agentleFS
veep2012veep2012/doc_mcp/.agents/skills/check-test-gaps/SKILL.md

check-test-gaps

Skill0 starsChanged 3 months agoMITView on GitHub

Review current functionality and available tests to identify behavior, integration, regression, and traceability gaps. Use for audit-only analysis by default, or with an explicit `fix` argument to close confirmed gaps.

The file

Show its rules and text

We split this skill into the rules it gives an agent

16 rules. About 0 are common, 15 are distinctive, and 1 is very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈15

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 1

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Search unit, smoke, integration, contract, scenario, and end-to-end tests.

    line 33
  2. Distinctive:

    Treat assertions that only inspect registration, strings, or mock calls as contract evidence, not proof of runtime behavior.

    line 35
  3. Distinctive:

    Check whether scenario documentation and tests are bidirectionally traceable when the repository uses scenario catalogs.

    line 36
  4. Distinctive:

    Run targeted existing tests first.

    line 39
  5. Distinctive:

    Follow repository-required validation commands for the affected area.

    line 40
  6. Distinctive:

    If a test cannot run, report the exact blocker and do not convert an unexecuted check into a pass.

    line 41
  7. Very specific:

    If fix was explicitly requested, close confirmed gaps.

    line 52
  8. Distinctive:

    Add or strengthen the smallest high-value tests first, preferring real runtime coverage where risk crosses a boundary.

    line 53
  9. Distinctive:

    Update scenario documentation and traceability mappings when the repository requires them.

    line 54
  10. Distinctive:

    If analysis proves the implementation defective, make the smallest production fix and apply all applicable documentation and testing skills.

    line 55
  11. Distinctive:

    Run targeted tests after each logical fix, then repository-required validation.

    line 56
  12. Distinctive:

    Do not assume proposed tests are complete or correct.

    line 61
  13. Distinctive:

    Do not call a feature covered merely because a test has the right name.

    line 62
  14. Distinctive:

    Prefer a small number of high-value runtime scenarios over broad shallow assertions.

    line 63
  15. Distinctive:

    Verify allowed and denied behavior separately where access control exists.

    line 64
  16. Distinctive:

    Verify empty, missing, and invalid cases separately.

    line 65

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Check Test Gaps

Assess what the code currently does, what the tests actually prove, and what remains unverified. Default mode is audit-only. An explicit fix argument, for example $check-test-gaps fix, authorizes closing confirmed gaps.

Inputs

  • Repository or workspace in scope.
  • Optional feature, module, command, MCP tool, or commit scope. If omitted, infer the smallest relevant scope from the request and recent implementation changes.
  • Optional mode: fix. Without it, make no repository changes.

Workflow

  1. Establish scope.
    • Inspect the working tree and recent relevant diffs without reverting user changes.
    • Locate implementation entry points under src/, CLI wrappers, configuration, documentation, and tests/.
    • Separate explicit requirements from examples, test suggestions, and incidental narrative.
  2. Build a behavior inventory from the implementation. Cover, when applicable:
    • happy paths and empty states;
    • malformed input, validation, and boundary values;
    • authentication, authorization, and hidden-resource behavior;
    • command output, MCP tool responses, errors, filtering, sorting, pagination, and idempotency;
    • local storage, indexing, vectorization, external services, retries, and cleanup;
    • backward compatibility, packaging, configuration, and documentation contracts.
  3. Map tests to behavior.
    • Search unit, smoke, integration, contract, scenario, and end-to-end tests.
    • Distinguish mocked tests from tests that exercise real external or runtime boundaries.
    • Treat assertions that only inspect registration, strings, or mock calls as contract evidence, not proof of runtime behavior.
    • Check whether scenario documentation and tests are bidirectionally traceable when the repository uses scenario catalogs.
  4. Exercise the smallest useful verification set.
    • Run targeted existing tests first.
    • Follow repository-required validation commands for the affected area.
    • If a test cannot run, report the exact blocker and do not convert an unexecuted check into a pass.
  5. Identify and rank gaps. Report only evidence-backed gaps. Classify each as:

    • P0: likely production failure, security issue, data loss, or broken core contract;
    • P1: important behavior or integration path is unverified or likely regressed;
    • P2: meaningful edge case, compatibility, or contract gap;
    • P3: low-risk completeness or maintainability gap.

    A gap should include the behavior at risk, implementation and test evidence, why existing coverage is insufficient, the smallest closing change, and whether it is required or optional hardening.

  6. If fix was explicitly requested, close confirmed gaps.
    • Add or strengthen the smallest high-value tests first, preferring real runtime coverage where risk crosses a boundary.
    • Update scenario documentation and traceability mappings when the repository requires them.
    • If analysis proves the implementation defective, make the smallest production fix and apply all applicable documentation and testing skills.
    • Run targeted tests after each logical fix, then repository-required validation.
    • Preserve unrelated user changes and report any gap that remains blocked.

Fresh-opinion rules

  • Do not assume proposed tests are complete or correct.
  • Do not call a feature covered merely because a test has the right name.
  • Prefer a small number of high-value runtime scenarios over broad shallow assertions.
  • Verify allowed and denied behavior separately where access control exists.
  • Verify empty, missing, and invalid cases separately.
  • Separate implementation defects from test gaps and mark recommendations beyond supplied requirements as hardening.

Output

Lead with covered, partially covered, or not covered.

Then provide findings ordered by priority, a behavior-to-test coverage map, exact validation results, and recommended next actions separated into required closure and optional hardening. In fix mode, also provide changed files and final validation results. In audit mode, explicitly state that no files were changed.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.