agentleFS
AnastasiyaWAnastasiyaW/claude-code-config/skills/development/bug-reproducer/SKILL.md

bug-reproducer

Skill213 starsChanged 3 days agoMITView on GitHub

Find likely software bugs in a codebase, rank concrete bug candidates, and prove or reject them with focused regression tests before proposing a fix. Also turn bug reports, stack traces, screenshots, failing behavior, support tickets, and regressions into minimal reproducible cases with red-to-green evidence. Use when Codex needs to hunt for unknown bugs, audit code for correctness defects, test suspicious edge cases, reproduce a reported failure, isolate root cause, or verify that an approved fix works without regressions. Honor explicit user authority for the requested fix; use approval gates only for authority that the request did not already grant or when scope materially changes. Do NOT use for ordinary implementation where no bug investigation or reproduction is needed.

We split this skill into the rules it gives an agent

22 rules. About 0 are common, 17 are distinctive, and 5 are very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈17

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 5

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    When the current request has not explicitly authorized creating and running a reproducer, present and stop at:

    line 18
  2. Distinctive:

    When the current request has not already authorized a causal production repair, present and stop at:

    line 44
  3. Very specific:

    Read references/bug-discovery-playbook.md before ranking candidates.

    line 77
  4. Distinctive:

    Look for falsifiable defects: off-by-one boundaries, inverted conditions, missing empty/null handling, unsafe state transitions, ordering …

    line 82
  5. Distinctive:

    Do not call security posture, performance, formatting, maintainability, or missing features a bug unless they violate a concrete product …

    line 85
  6. Distinctive:

    If the request explicitly asked to reproduce a supplied symptom, create a regression test, or otherwise authorized reproduction work, …

    line 100
  7. Distinctive:

    Create only the approved test or harness.

    line 107
  8. Distinctive:

    Use deterministic inputs and the smallest fixture that reaches the real production path.

    line 108
  9. Distinctive:

    Stop after evidence when the user requested discovery or reproduction only.

    line 118
  10. Distinctive:

    If the current request already authorized the causal fix, record how the patch remains inside it and continue.

    line 123
  11. Distinctive:

    Prefer the smallest causal fix over symptom suppression.

    line 130
  12. Distinctive:

    Do not weaken assertions, catch and ignore errors, add arbitrary retries, disable tests, or broaden tolerances merely to turn the test …

    line 131
  13. Distinctive:

    Run the exact same targeted command used for failing evidence.

    line 135
  14. Very specific:

    When the exact targeted reproducer is genuinely the only proportionate relevant check, do not reuse fixed.json as --relevant-evidence or …

    line 145
  15. Distinctive:

    When the user supplies a symptom, error, screenshot, stack trace, or failing behavior:

    line 157
  16. Very specific:

    Read references/reproduction-playbook.md when selecting the smallest credible layer.

    line 163
  17. Distinctive:

    Never claim a bug from code inspection alone.

    line 176
  18. Distinctive:

    If no bug is proven, preserve the project and say so plainly.

    line 200
  19. Very specific:

    Treat --reproduction confirmed as operator input, not independent proof.

    line 207
  20. Distinctive:

    Do not use the upstream installer when the destination may already exist: it force-removes the destination.

    line 214
  21. Very specific:

    FIX_UNVERIFIED: run and capture the proportionate relevant check, or explicitly record why the targeted reproducer is sufficient.

    line 236
  22. Distinctive:

    INCONCLUSIVE: check that before and after commands are byte-for-byte the same and that the failure signal matches the predicted assertion.

    line 239

≈ “Common” is an estimate: at least 1 in 5 of the 308,232 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Bug Reproducer

Turn a codebase or bug report into evidence. When no bug is supplied, discover concrete candidates from the code and its contracts, then try to prove the strongest candidates with focused tests. Never present a suspicion as a confirmed bug.

Honor existing authority, then apply missing gates

Invocation alone to hunt for unknown bugs is inspection-only. A direct request to fix or implement a reported bug, or to find and fix bugs in a named repository, authorizes the normal reversible reproduction tests and causal production edits inside that stated task. A direct request to reproduce a reported bug or create its regression test likewise authorizes the normal reversible reproduction files and commands, but not a production repair. Record the matching task scope and proceed without stopping for duplicate confirmation, even when the exact responsible file is learned during diagnosis. Do not ask the user to approve the same scope twice.

If the user asked only to inspect, audit, find, or isolate, do not infer permission to create reproduction files or change production code. A direct reproduction or regression-test request authorizes only the normal reversible reproduction work described above; it does not authorize a production repair. Before a gate that has not been satisfied, do not create or edit project files, install dependencies, run formatters or migrations, modify configuration, generate reports, create worktrees, or execute commands likely to mutate project state. Read source, configuration, documentation, existing tests, user-supplied logs, and Git history. Run an existing targeted test only when it is clearly safe and does not require project changes.

Gate 1 — test the candidate

When the current request has not explicitly authorized creating and running a reproducer, present and stop at:

## Bug candidates

| # | Candidate | Contract evidence | Trigger | Location | Confidence |
|---|---|---|---|---|---|
| 1 | ... | ... | ... | file:line | high/medium |

## Proposed bug test

- Candidate(s) to test:
- Why each could be a real bug:
- Exact files to create or edit:
- Minimal fixture/input:
- Test or harness command:
- Signal that will confirm each bug:
- Main risk or uncertainty:

No project files have been modified. Do you want me to create and run these tests?

List only candidates backed by a reachable code path, a defensible expected behavior, and a specific triggering input or state. Approval covers only the displayed reproduction files and commands. A direct request to reproduce a supplied symptom or write its regression test already satisfies this gate: record that scope and continue without requiring file names that diagnosis has not yet established. Test one strong candidate by default; batch at most three only when their files and commands are all explicit.

Gate 2 — fix a proven bug

When the current request has not already authorized a causal production repair, present and stop at:

## Proposed fix

- Reproduction status: REPRODUCED
- Proven bug:
- Root cause:
- Exact production files to change:
- Proposed transformation:
- Behavior that must remain identical:
- Regression and broader test plan:
- Main risk:

The bug is proven by a failing test, but no production fix has been applied. Do you want me to apply this exact fix?

Continue when the current request already covers the causal repair or after explicit approval. If the file list, dependencies, public behavior, risk tier, or approach materially changes beyond that authority, request fresh approval. Never bundle unrelated cleanup or another fix into the approved patch.

Choose the workflow

  • hunt-and-prove — Default when no specific bug is supplied. Discover, rank, and test likely correctness bugs.
  • reproduce-only — Stop after a minimal failing case is proven. Use when the user asks only to find, reproduce, isolate, or write regression tests.
  • prove-fix — Use for a reported bug or after a discovered candidate is proven and the user wants it fixed. Apply only gates not already satisfied by the current request, then prove red to green.
  • flaky — Reproduce timing, ordering, seed, isolation, or concurrency-dependent failures across repeated controlled runs. Do not label one intermittent failure as reproduced.

Run hunt-and-prove

1. Map the project read-only

  • Identify runtime, entry points, public interfaces, data boundaries, test framework, existing commands, and high-change or high-risk modules.
  • Derive intended behavior from tests, types, schemas, documentation, callers, UI copy, API contracts, and invariants. Prefer explicit contracts over personal style preferences.
  • Inspect recent changes only when repository history is available; do not assume old code is correct.
  • Read references/bug-discovery-playbook.md before ranking candidates.

2. Generate concrete candidates

  • Trace user-controlled or boundary inputs through real reachable paths.
  • Look for falsifiable defects: off-by-one boundaries, inverted conditions, missing empty/null handling, unsafe state transitions, ordering or deduplication errors, stale cache keys, permission gaps, precision/time-zone mistakes, async races, inconsistent validation, and error paths that violate the surrounding contract.
  • For every candidate, identify the exact path, triggering input/state, expected result, likely actual result, and evidence for the expectation.
  • Reject vague possibilities such as “this could be null” unless the codebase permits null and the path mishandles it.
  • Do not call security posture, performance, formatting, maintainability, or missing features a bug unless they violate a concrete product contract.

3. Rank before testing

Rank candidates using:

  1. Contract strength — Is expected behavior explicit in tests, types, docs, schemas, callers, or consistent nearby behavior?
  2. Reachability — Can a real caller or valid input reach the path?
  3. Reproducibility — Can a small deterministic test distinguish correct from incorrect behavior?
  4. Impact — Does it affect outputs, data, permissions, crashes, or a user-visible workflow?

Show no more than five candidates and label confidence high, medium, or low. Do not propose testing low-confidence candidates while a stronger one exists. If no candidate survives this filter, return NO_BUG_PROVEN and identify the next useful evidence instead of inventing a bug.

4. Resolve Gate 1 authority

  • If the request explicitly asked to reproduce a supplied symptom, create a regression test, or otherwise authorized reproduction work, record the matching task scope and continue. Do not require exact file names before diagnosis establishes them.
  • Otherwise show the ranked shortlist and exact test plan for the strongest one to three candidates.
  • Name every file and command that approval would cover.
  • State that no project files have been modified, then stop and wait.

5. Test approved candidates

  • Create only the approved test or harness.
  • Use deterministic inputs and the smallest fixture that reaches the real production path.
  • Assert the intended contract, not the current implementation.
  • Capture the narrow command with scripts/capture_command.py when appropriate:
python3 "${CLAUDE_SKILL_DIR}/scripts/capture_command.py" --label reproduced --output reproduced.json -- npm test -- path/to/regression.test.ts
  • Confirm that a failure matches the predicted behavior and cause. Syntax errors, missing dependencies, invalid fixtures, unrelated failures, and assertions built on an unsupported assumption reject or invalidate the candidate.
  • Return REPRODUCED, NOT_REPRODUCED, or INCONCLUSIVE for each tested candidate. Clearly separate rejected speculative tests by default. Delete them only with explicit user authority.
  • Stop after evidence when the user requested discovery or reproduction only. Do not slide into production changes.

6. Isolate and resolve Gate 2 authority

  • Trace a reproduced failure to the smallest responsible condition and distinguish root cause from the line where it surfaces.
  • If the current request already authorized the causal fix, record how the patch remains inside it and continue.
  • Otherwise show Gate 2 with exact production files, transformation, preserved behavior, checks, and risk, then stop and wait for separate approval.

7. Apply only the approved fix

  • Preserve the regression test unless the user explicitly requests a temporary harness.
  • Change only the approved production files and necessary test expectations.
  • Prefer the smallest causal fix over symptom suppression.
  • Do not weaken assertions, catch and ignore errors, add arbitrary retries, disable tests, or broaden tolerances merely to turn the test green.

8. Prove red to green

  • Run the exact same targeted command used for failing evidence.
  • Run the narrowest additional check that meaningfully covers the changed behavior and its integration boundary. Escalate to a broader relevant suite, typecheck, lint, or build when the change's risk or contract requires it; record the selected scope and any unavailable or disproportionate checks as limitations.
  • Capture and classify the fixed run:
python3 "${CLAUDE_SKILL_DIR}/scripts/capture_command.py" --label fixed --output fixed.json -- npm test -- path/to/regression.test.ts
python3 "${CLAUDE_SKILL_DIR}/scripts/capture_command.py" --label relevant-check --output relevant-check.json -- npm test -- path/to/affected-area
python3 "${CLAUDE_SKILL_DIR}/scripts/compare_evidence.py" reproduced.json fixed.json result.json --reproduction confirmed --relevant-evidence relevant-check.json

When the exact targeted reproducer is genuinely the only proportionate relevant check, do not reuse fixed.json as --relevant-evidence or pretend an additional command ran. Record that boundary explicitly instead:

python3 "${CLAUDE_SKILL_DIR}/scripts/compare_evidence.py" reproduced.json fixed.json result.json --reproduction confirmed --targeted-scope-sufficient --scope-rationale "Pure function; no additional integration boundary exists."
  • Classify a passing targeted test with a failing captured relevant check as FIX_REGRESSION.
  • Classify a passing targeted test with a reused targeted receipt presented as an additional check as FIX_UNVERIFIED.
  • Classify a passing targeted test without a captured proportionate relevant check as FIX_UNVERIFIED, unless the project genuinely has no additional meaningful check and --targeted-scope-sufficient records the explicit rationale.

Handle an existing bug report

When the user supplies a symptom, error, screenshot, stack trace, or failing behavior:

  1. Restate expected behavior, actual behavior, trigger, environment, frequency, and last-known-good version.
  2. Separate observed facts from assumptions and remove secrets or personal data.
  3. Map the report to likely paths and existing test conventions.
  4. Skip broad discovery; preserve reproduction integrity and red-to-green proof, but do not repeat Gate 1 or Gate 2 when the reported-bug fix request already satisfies them.
  5. Read references/reproduction-playbook.md when selecting the smallest credible layer.

Use evidence labels precisely

  • REPRODUCED — A focused case fails deterministically for the predicted or reported reason.
  • NOT_REPRODUCED — The approved case does not produce the predicted failure.
  • NO_BUG_PROVEN — Read-only discovery or approved candidate tests did not prove a correctness defect.
  • INCONCLUSIVE — Environment, nondeterminism, missing access, or ambiguous signals prevent a conclusion.
  • STILL_FAILING — The same reproducer continues to fail after an attempted fix.
  • FIX_UNVERIFIED — The reproducer passes, but proportionate correctness evidence or an explicit targeted-only scope rationale is missing.
  • FIX_REGRESSION — The reproducer passes or changes, but a captured relevant correctness check fails.
  • FIX_PROVEN — The same reproducer goes red to green and either a captured additional proportionate relevant check passes or targeted-only scope is explicitly justified.

Never claim a bug from code inspection alone. Never claim a fix without red-to-green evidence.

Create the native report

Create a native report only when the user requests one or the repository requires one. Use the existing project evidence or audit location specified by the user or repository; do not create a generic outputs/ directory. Prepare context JSON following references/report-schema.md, including discovery scope and ranked candidates when using hunt-and-prove, then run:

python3 "${CLAUDE_SKILL_DIR}/scripts/generate_report.py" result.json context.json path/to/existing-evidence-location/bug-reproducer-report.md

Include discovery evidence, tested candidates, minimal reproduction, root cause, approvals and scope, changed files, red/green commands, broader checks, limitations, and residual risks. Link the Markdown report in the final response.

Hand off

Lead with the strongest evidence label, then report:

  1. Scope inspected and candidates considered
  2. Candidate tests and outcomes
  3. What reproduced and why the failure is credible
  4. Root cause, if proven
  5. Approved fix and red-to-green evidence, if requested
  6. Broader checks, limitations, and residual risk
  7. Link to the report when one was requested

If no bug is proven, preserve the project and say so plainly. A clean hunt is evidence about the inspected scope, not proof that the entire codebase has no bugs.

Local operating rules

  • On Windows, prefer an explicit verified Python executable in capture commands when the python launcher is slow or resolves to a store shim. Record the runtime in the evidence JSON.
  • Treat --reproduction confirmed as operator input, not independent proof. compare_evidence.py accepts an additional passing check only through a captured --relevant-evidence receipt that is distinct from the targeted reproducer. If the targeted reproducer is sufficient, declare that scope and rationale explicitly. The agent or a fresh verifier must inspect the captured commands, exit codes, output, and relevant-check scope before accepting the status.
  • Do not use the upstream installer when the destination may already exist: it force-removes the destination. A backup does not authorize that removal. Install only into an absent destination; request explicit replacement or deletion authority before touching an existing one, then verify the resulting file list.

Gotchas

  • A passing focused test before a fix means NOT_REPRODUCED, even if the code looks suspicious.
  • A syntax error, missing dependency, invalid fixture, or unrelated failing suite invalidates the reproduction; it is not a product bug.
  • A clean hunt covers only the inspected scope. It never proves that the whole repository is bug-free.
  • compare_evidence.py classifies recorded receipts and declared scope; it does not prove causal root cause, independently run the relevant check, or decide whether targeted-only scope is actually sufficient.

Troubleshooting

  • capture command hangs on Windows: replace the launcher with the explicit verified Python executable, reduce the timeout, and rerun the same command.
  • FIX_UNVERIFIED: run and capture the proportionate relevant check, or explicitly record why the targeted reproducer is sufficient; do not upgrade the label by hand.
  • INCONCLUSIVE: check that before and after commands are byte-for-byte the same and that the failure signal matches the predicted assertion.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.