agentleFS
randommoniclerandommonicle/claude-skills/findings-are-evidence/SKILL.md

findings-are-evidence

Skill27 starsChanged 21 days agoApache-2.0View on GitHub

A subagent, reviewer, or scout report is evidence, not findings — and so is your own first-hand defect analysis. Re-derive every Critical or High claim, everything touching a regulatory anchor, and the reasoning about the fix from the primary source before acting or writing it into a durable artifact. Triggers when consuming any agent or reviewer output and when recording a defect or fix analysis. Does not fire on low-severity suggestions with no gating or regulatory consequence — sample those rather than re-deriving them all.

The file

We split this skill into the rules it gives an agent

2 rules. About 0 are common, 1 is distinctive, and 1 is very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈1

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 1

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Very specific:

    A severity label is a hypothesis: Before gating anything on a "Blocker", refute it against ground truth — the installed node_modules …

    line 23
  2. Distinctive:

    Your own conclusions qualify: Verify the claim you make about the FIX, not just the claim you were given — the remedy's reasoning earns its …

    line 29

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Findings are evidence

Ten incidents across two repos of acting on an overstated, stale, or simply wrong claim that arrived wearing a severity label: a "critical" shared-phone exploit refuted by reading the installed dependency's source; a reviewer's suggested correction that was itself wrong on the statute; a scout asserting a directory did not exist when it did; a verifier "blessing" a wrong claim because the brief it was handed contained the error. Layer: one of the six always-on norms; this file is the playbook.

The rule

Reports are inputs to verification, not outputs of it. Before a claim gates a merge, enters a durable artifact, or triggers work: re-derive it from the primary source if it is rated Critical or High, touches a regulatory anchor, or is your own analysis of a defect or fix.

How to apply

  • A severity label is a hypothesis. Before gating anything on a "Blocker", refute it against ground truth — the installed node_modules source, the live catalog, the actual runtime — not against the reporter's confidence.
  • The brief handed to a verifier is itself a claim. A verification pass inherits its brief's errors; a specialist contradicting the brief earns a primary-source check, not an override.
  • Your own conclusions qualify. Verify the claim you make about the FIX, not just the claim you were given — the remedy's reasoning earns its own verification pass.
  • A failure message is a symptom, not a diagnosis ("not recognized" is not "not installed"). This is the canonical home of that rule; verified-citations cross-references it.
  • A convenience tool that mirrors a first-party CLI must be diffed against the CLI before its output is committed — an MCP typegen once emitted a 483-line-short file that passed every gate. Prefer the path the project's own scripts drive.
  • A wrong exploit can still sit on a real smell. Fix what is real; drop the inflated severity. Refutation is not exoneration.

What this skill does not do

It does not organise multi-reviewer processes (committee-review) and does not govern citation formatting (verified-citations). It governs the epistemic status of claims, whoever produced them.

Route

The claim you are weighing is not a review of the work but a statement inside the artefact you are auditing, of the "verified against the ledger" or "a demand was pulled and checked" kind: load trace-one-record, rule 3. Same principle, different trigger, and a reader auditing a spreadsheet will not think to load a skill about agent findings.

Why

Agents and reviewers are rewarded for finding things, so their output skews confident; and self-produced analysis carries the same bias with less scrutiny. Every incident in the evidence was cheaper to re-derive than to act on wrongly. Evidence: PropOS LESSONS_LEARNED Sessions 12, 15, 16, 22, 35, 42, 43, 2026-07-07, 2026-07-20; ASH LESSONS_LEARNED 2026-07-09.

Additions from the misses-log sweep (2026-10-22)

  • On a money path, keep every review layer. The builder's red-proofs, the review seats and the final gate each caught what the others passed; none is redundant because the layer before it was green. (AI domain L-112.)

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.