stateful-evidence-reasoning
Skill0 starsChanged 36 days agoMITView on GitHub
Answer multi-document or large-corpus questions by tracking source-linked evidence, revisable conclusions, and unresolved gaps. Use when retrieval, conflicting versions, or calculations could cause an answer to drift from its sources.
In this repository13 other files it gives its agents.
- advocatus-diaboliSkill
- agentic-harness-engineeringSkill
- agent-instruction-reliabilitySkill
- agent-instructionsSkill
- agent-orchestrationSkill
- context-loadingSkill
- context-managementSkill
- copilot-usage-baselineSkill
- learning-loopSkill
- research-to-skillSkill
- skill-refinementSkill
- technical-documentationSkill
- ticket-craftSkill
The file
We split this skill into the rules it gives an agent
9 rules. About 0 are common, 9 are distinctive, and 0 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈9
Distinctive · estimate
This author's own choices. Worth a look.
0
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 13
Search for those facts in the available corpus.
- Distinctive: line 14
When the work spans several interactions, keep a compact working record with two distinct parts:
- Distinctive: line 17
Use the available notes or files.
- Distinctive: line 18
If retrieved notes or summaries repeat the same source statement, link them to its original evidence ID instead of counting them as …
- Distinctive: line 20
When asked what the overall evidence or corpus supports, check opposing findings and relevant source groups before generalizing.
- Distinctive: line 24
Stop searching when the material gaps are resolved, or when additional available searches are unlikely to change the answer within the …
- Distinctive: line 28
If two sources disagree, check whether period, definition, revision status, or units explain the difference.
- Distinctive: line 29
If a citation cannot be reopened or a value cannot be verified beyond a snippet, label it unverified and avoid presenting it as established …
- Distinctive: line 30
If a correction affects a prior calculation, recompute from active operands before finalizing.
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Stateful Evidence Reasoning
Use this workflow when the answer depends on evidence found across multiple searches, documents, versions, or calculations. For a straightforward question answered by one inspected passage, cite that passage directly and keep the workflow light. This skill adapts the reasoning practice in LongHarness; it does not provide that paper's controller, EvidenceBank API, or measured performance gains.
Work from the decision
- State the requested answer, relevant period, population, definitions, units, and output format. Identify the facts whose absence or correction could change it.
- Search for those facts in the available corpus. Treat search results as leads; inspect the underlying passage, table, or original artifact before using a statement as evidence. Preserve a locator a reader can revisit (document and page, section, line, or stable URL).
- When the work spans several interactions, keep a compact working record with two distinct parts:
- Evidence: an ID, narrowly worded source statement, locator, applicable date/units/qualifiers, and
active,superseded, orretractedstatus. - Conclusion: established claims and tentative hypotheses linked to active evidence IDs, plus open gaps phrased as facts that could change the answer. Use the available notes or files; no special storage system is required. Do not promote an inference, search snippet, or unsupported recollection into the evidence record. If retrieved notes or summaries repeat the same source statement, link them to its original evidence ID instead of counting them as independent support. Retain distinct details needed for the task.
- Evidence: an ID, narrowly worded source statement, locator, applicable date/units/qualifiers, and
- Choose the next search or read because it could resolve a material open gap, distinguish competing explanations, or check a fragile source value. After reading, add only source-faithful statements. If new material corrects or invalidates an entry, mark the old entry inactive, record its replacement or retraction, and revisit conclusions and calculations that used it. Do not silently overwrite the old value. When asked what the overall evidence or corpus supports, check opposing findings and relevant source groups before generalizing. Report coverage limits and scope the conclusion to inspected evidence when coverage is incomplete. Accurate citations alone do not establish representativeness.
- For derived answers, record the formula and each operand's active evidence ID, period, and unit. Check that the operand matches the inspected source; use a deterministic calculation tool when useful. If a parsed table, scan, or chart is ambiguous and the original is available, check the original representation.
- Before answering, follow every material claim and operand back to active source evidence. Resolve gaps that could change the result within the authorized time and access. If a material conflict or missing source remains, give a qualified answer or ask for the specific missing choice. Cite the inspected sources and state consequential uncertainty.
Stop searching when the material gaps are resolved, or when additional available searches are unlikely to change the answer within the task's constraints. Do not impose the paper's fixed turn, search, or token budgets on a different environment.
When the loop stalls
- If two sources disagree, check whether period, definition, revision status, or units explain the difference. Keep both statements and the unresolved distinction until it is settled.
- If a citation cannot be reopened or a value cannot be verified beyond a snippet, label it unverified and avoid presenting it as established evidence.
- If a correction affects a prior calculation, recompute from active operands before finalizing.
Load the evidence assessment when adapting this workflow to another environment or making performance claims. Use the evaluation cases to test changes to its decision rules.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

