evidence-first-answer
Skill29 starsChanged 7 months agoMITView on GitHub
Required pre-flight before answering any "why" or "are we" question about revenue, conversion, outbound, traffic, or commercial state. Forces verification of live data and distinguishes planning docs from telemetry. Triggered automatically when the CEO asks "are you sure?" — that phrase means the previous answer was wrong.
We split this skill into the rules it gives an agent
8 rules. About 0 are common, 7 are distinctive, and 1 is very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈7
Distinctive · estimate
This author's own choices. Worth a look.
1
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 15
Before writing any phrase that implies traction or its absence
- Distinctive: line 27
If the doc's last-updated date is older than 14 days, treat its numbers as historical, not current.
- Very specific: line 45
When in doubt, run revenue-truth skill — query the live endpoint.
- Distinctive: line 49
Before submitting an answer, write down: *"What single piece of evidence would prove this answer wrong?"* Then go look for that evidence.
- Distinctive: line 64
Do not restate: Do not add caveats to the previous answer.
- Distinctive: line 67
Find what you got wrong: before defending what you got right.
- Distinctive: line 70
If the CEO asks "are you sure?" a second time, the answer is structurally wrong — not just numerically off.
- Distinctive: line 76
If a third time: stop, ask the CEO what specific evidence I'm missing, and re-bootstrap from scratch.
≈ “Common” is an estimate: at least 1 in 5 of the 308,232 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Evidence-First Answer — The "Are You Sure?" Discipline
When to invoke
- Any user question that contains: "why didn't", "how come no", "are we", "what's our", "did we", "how much", "revenue", "money", "customers", "conversion", "traffic", "leads", "sales"
- Any pushback that contains: "are you sure?", "really?", "is that right?", "verify", "prove it"
- Before writing any phrase that implies traction or its absence
The hard discipline (4 steps, no skipping)
1. Date-check every number you're about to cite
# For any doc you're about to quote:
git log -1 --format='%ai %s' -- <path>
grep -E "^Updated:|^Status:|2026-" <path> | head -5If the doc's last-updated date is older than 14 days, treat its numbers as historical, not current. Say "as of <date>" explicitly.
2. Distinguish "plan" from "telemetry"
Words/phrases that mean the number is a forecast, not an actual:
- "30-day revenue plan showed..."
- "Modeled target..."
- "Projected..."
- "If we hit..."
- Any number inside
docs/MONETIZATION_EXEC_SUMMARY_*.mdpast line 30 - Any number inside
reports/gtm/*that isn't backed by a same-filecurloutput
Words/phrases that mean the number is measured:
- "
getBillingSummaryreturned..." - "
curl /v1/billing/summaryJSON..." - "Stripe-reconciled charges..."
- A bash code block with the actual command + output
When in doubt, run revenue-truth skill — query the live endpoint.
3. The "what would change my mind" test
Before submitting an answer, write down: "What single piece of evidence would prove this answer wrong?" Then go look for that evidence. If you find it, rewrite. If you can't find a falsifier, your hypothesis is probably too vague — refine it.
4. State your uncertainty explicitly
End every answer that touches commercial state with:
- What I verified: (curl outputs, file dates, commit SHAs)
- What I'm assuming: (and why)
- What would change the answer: (the specific check the user can run)
The "Are You Sure?" rule (from CLAUDE.md)
When the CEO says "are you sure?" — you're wrong. Dig deeper. Do not defend your current hypothesis. Re-examine from scratch.
Concrete protocol when this triggers:
- Do not restate. Do not add caveats to the previous answer.
- Re-read the docs you cited, checking dates and source labels.
- Run the live check (
revenue-truthskill or equivalent). - Find what you got wrong before defending what you got right.
- Reply with the correction first, then the new answer.
If the CEO asks "are you sure?" a second time, the answer is structurally wrong — not just numerically off. Look for unstated assumptions:
- Am I treating credentials/tokens as terminal blockers when manual routes exist?
- Am I confusing drafted work with sent work?
- Am I confusing engineering velocity with commercial velocity?
- Am I quoting forecasts as actuals?
If a third time: stop, ask the CEO what specific evidence I'm missing, and re-bootstrap from scratch. Do not produce a fourth answer of the same shape.
Anti-patterns this skill exists to prevent
| Pattern | Why it's wrong |
Quoting 5,984 visitors from a "30-day revenue plan" as if measured | It's a forecast, not telemetry |
Citing docs/VERIFICATION_EVIDENCE.md March-19 numbers as "current 30d" two months later | Numbers don't auto-refresh |
| Saying "blocked by Gmail SMTP / LinkedIn token" without trying the manual route | Tokens fail; humans don't |
Conflating "drafted in gtm-revenue-loop.md" with "sent" | Drafting is not sending |
| Saying "deployed" or "live" without curl output | Hard-block rule #6 |
Exit criteria
An answer is ready when you can show:
- A live curl OR a file path + line number with a date check, for every number
- A "what would change my mind" sentence
- No "should", "probably", "I think" without "verified by
<command>" attached
In this repository98 other files it gives its agents.
- AGENTS.mdAGENTS.md
- CLAUDE.mdCLAUDE.md
- .well-known/llms.txtllms.txt
- activesaddler-curriculum-honestySkill
- article-syndication-pipelineSkill
- autonomous-execution-mandateSkill
- aws-strands-harness-not-cloneSkill
- bolt-forge-opt-in-not-cloneSkill
- ci-gha-buildkite-patterns-not-cloneSkill
- cobble-hot-store-compare-not-cloneSkill
- colab-compute-honesty-not-cloneSkill
- comet-session-loggerSkill
- craft-playbook-gateSkill
- cyberstrike-compare-not-cloneSkill
- datadog-llm-obs-compare-not-cloneSkill
- decisive-step-evaluatorSkill
- deeppattern-discipline-honesty-not-cloneSkill
- earnie-third-author-governanceSkill
- embeddinggemma-multimodal-firewallSkill
- fiddler-control-plane-honestySkill
- gitlab-sandbox-allowlist-not-trustSkill
- graphifySkill
- halo-trace-optimize-not-cloneSkill
- harness-evolution-ceilingSkill
- ideabrowser-connectorSkill
- infoq-architect-honesty-not-cloneSkill
- jit-harness-compare-not-cloneSkill
- meko-datapack-honesty-not-cloneSkill
- mintlify-knowledge-honesty-not-cloneSkill
- model-distress-governanceSkill
- multi-harness-rl-invariantsSkill
- nvidia-specdecode-al-doctorSkill
- omp-coordination-honesty-not-cloneSkill
- openui-catalog-compose-honestySkill
- package-manager-honesty-doctorSkill
- qwenwork-policy-group-honesty-not-cloneSkill
- saas-moat-honesty-not-cloneSkill
- salt-code-policy-honesty-not-cloneSkill
- show-meSkill
- siren-mcp-governanceSkill
- skool-headless-readerSkill
- snapchat-abm-playbook-stealSkill
- strands-harness-sentinelSkill
- tailscale-p2p-governance-not-cloneSkill
- thumbgate-board-loopSkill
- thumbgate-daily-discoveriesSkill
- thumbgateSkill
- token-shunt-honesty-not-cloneSkill
- typesafe-typed-questions-not-cloneSkill
- vs-coverage-gap-not-cloneSkill
- vulnerability-pre-action-diodeSkill
- windbg-evidence-diagnosticsSkill
- wisdom-context-artifact-not-cloneSkill
- zero-outbound-spend-they-pay-usSkill
- zvec-grep-compare-not-cloneSkill
- ci-failure-triageSkill
- fleet-coordinationSkill
- paranoid-mode-honesty-not-cloneSkill
- revenue-truthSkill
- scope-disciplineSkill
- The first 60 shown.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

