agentleFS
kremakrema/agent-skills/skills/stateful-evidence-reasoning/SKILL.md

stateful-evidence-reasoning

Skill0 starsChanged 36 days agoMITView on GitHub

Answer multi-document or large-corpus questions by tracking source-linked evidence, revisable conclusions, and unresolved gaps. Use when retrieval, conflicting versions, or calculations could cause an answer to drift from its sources.

The file

We split this skill into the rules it gives an agent

9 rules. About 0 are common, 9 are distinctive, and 0 are very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈9

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 0

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Search for those facts in the available corpus.

    line 13
  2. Distinctive:

    When the work spans several interactions, keep a compact working record with two distinct parts:

    line 14
  3. Distinctive:

    Use the available notes or files.

    line 17
  4. Distinctive:

    If retrieved notes or summaries repeat the same source statement, link them to its original evidence ID instead of counting them as …

    line 18
  5. Distinctive:

    When asked what the overall evidence or corpus supports, check opposing findings and relevant source groups before generalizing.

    line 20
  6. Distinctive:

    Stop searching when the material gaps are resolved, or when additional available searches are unlikely to change the answer within the …

    line 24
  7. Distinctive:

    If two sources disagree, check whether period, definition, revision status, or units explain the difference.

    line 28
  8. Distinctive:

    If a citation cannot be reopened or a value cannot be verified beyond a snippet, label it unverified and avoid presenting it as established …

    line 29
  9. Distinctive:

    If a correction affects a prior calculation, recompute from active operands before finalizing.

    line 30

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Stateful Evidence Reasoning

Use this workflow when the answer depends on evidence found across multiple searches, documents, versions, or calculations. For a straightforward question answered by one inspected passage, cite that passage directly and keep the workflow light. This skill adapts the reasoning practice in LongHarness; it does not provide that paper's controller, EvidenceBank API, or measured performance gains.

Work from the decision

  1. State the requested answer, relevant period, population, definitions, units, and output format. Identify the facts whose absence or correction could change it.
  2. Search for those facts in the available corpus. Treat search results as leads; inspect the underlying passage, table, or original artifact before using a statement as evidence. Preserve a locator a reader can revisit (document and page, section, line, or stable URL).
  3. When the work spans several interactions, keep a compact working record with two distinct parts:
    • Evidence: an ID, narrowly worded source statement, locator, applicable date/units/qualifiers, and active, superseded, or retracted status.
    • Conclusion: established claims and tentative hypotheses linked to active evidence IDs, plus open gaps phrased as facts that could change the answer. Use the available notes or files; no special storage system is required. Do not promote an inference, search snippet, or unsupported recollection into the evidence record. If retrieved notes or summaries repeat the same source statement, link them to its original evidence ID instead of counting them as independent support. Retain distinct details needed for the task.
  4. Choose the next search or read because it could resolve a material open gap, distinguish competing explanations, or check a fragile source value. After reading, add only source-faithful statements. If new material corrects or invalidates an entry, mark the old entry inactive, record its replacement or retraction, and revisit conclusions and calculations that used it. Do not silently overwrite the old value. When asked what the overall evidence or corpus supports, check opposing findings and relevant source groups before generalizing. Report coverage limits and scope the conclusion to inspected evidence when coverage is incomplete. Accurate citations alone do not establish representativeness.
  5. For derived answers, record the formula and each operand's active evidence ID, period, and unit. Check that the operand matches the inspected source; use a deterministic calculation tool when useful. If a parsed table, scan, or chart is ambiguous and the original is available, check the original representation.
  6. Before answering, follow every material claim and operand back to active source evidence. Resolve gaps that could change the result within the authorized time and access. If a material conflict or missing source remains, give a qualified answer or ask for the specific missing choice. Cite the inspected sources and state consequential uncertainty.

Stop searching when the material gaps are resolved, or when additional available searches are unlikely to change the answer within the task's constraints. Do not impose the paper's fixed turn, search, or token budgets on a different environment.

When the loop stalls

  • If two sources disagree, check whether period, definition, revision status, or units explain the difference. Keep both statements and the unresolved distinction until it is settled.
  • If a citation cannot be reopened or a value cannot be verified beyond a snippet, label it unverified and avoid presenting it as established evidence.
  • If a correction affects a prior calculation, recompute from active operands before finalizing.

Load the evidence assessment when adapting this workflow to another environment or making performance claims. Use the evaluation cases to test changes to its decision rules.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.