confidence-tag
Skill0 starsChanged 5 months agoMITView on GitHub
Don't present a uniform wall of equally-confident sentences. Label what's solid, what's reasoned, and what's a guess — and roughly how sure you are.
In this repository16 other files it gives its agents.
- assumption-auditSkill
- cite-checkSkill
- compactSkill
- context-budgetSkill
- devils-advocateSkill
- distillSkill
- first-principlesSkill
- handoffSkill
- pre-mortemSkill
- red-teamSkill
- rubber-duckSkill
- scope-cutterSkill
- scratchpadSkill
- self-consistencySkill
- steelmanSkill
- teach-backSkill
The file
We split this skill into the rules it gives an agent
2 rules. About 0 are common, 2 are distinctive, and 0 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈2
Distinctive · estimate
This author's own choices. Worth a look.
0
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 7
Don't present a uniform wall of equally-confident sentences.
- Distinctive: line 18
When the real fix is to verify, not to hedge — if you *can* check a fact, check it (cite-check) instead of stamping it "medium confidence."
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
name: confidence-tag description: Attaches a calibrated confidence level to each part of an answer and separates FACT from INFERENCE from GUESS, so the user knows exactly what to trust and what to go verify before acting. Use this skill when the answer mixes solid knowledge with shaky parts, when the domain is uncertain or fast-moving, when the user asks "how sure are you?" or "what do you actually know vs. assume?", or when they're making a decision under uncertainty and need the confident parts and the hand-wavy parts clearly told apart.
Confidence Tag
Don't present a uniform wall of equally-confident sentences. Label what's solid, what's reasoned, and what's a guess — and roughly how sure you are.
When to use
- Answers that blend things you know well with things you're extrapolating or guessing. - Uncertain, niche, or fast-moving domains where parts of your knowledge may be stale or thin. - The user asks "how sure are you," "what's your confidence," or "what do you actually know vs. assume." - Decisions under uncertainty, where the user needs to know which parts to lean on and which to double-check first.
When NOT to use
- Simple, fully-known answers where tagging every clause is just clutter ("what's 2+2"). - Pure creative or opinion work where "confidence" doesn't apply. - When the real fix is to verify, not to hedge — if you can check a fact, check it (cite-check) instead of stamping it "medium confidence." - As a blanket disclaimer to dodge commitment; calibrated labels, not reflexive "I might be wrong about everything."
The method
1. Break the answer into claims. Split your response into the distinct statements it rests on. 2. Classify each by epistemic type: - FACT — established, checkable, you're confident it's correct. - INFERENCE — a reasoned conclusion you drew from facts or context; sound but not directly observed. - GUESS — plausible but speculative; you'd want it verified before anyone relied on it. 3. Calibrate a confidence level on each (High / Medium / Low, or a rough %). Be honest: High means "I'd bet on this," Low means "this is a hunch." 4. Make calibration mean something. Don't mark everything Medium. Reserve High for things you'd stake the answer on; use Low freely when you're genuinely unsure — that's the signal the user needs. 5. Expose the basis. For Medium/Low items, add a few words on why it's uncertain (outside my cutoff, conflicting sources, depends on an assumption). 6. Lead with the load-bearing uncertainties. If the user's decision hinges on a Low-confidence GUESS, surface that prominently rather than burying it. 7. State what would raise confidence. Name the check or data point that would move a Low to High, so the user knows what to go get.
What good looks like
- A glance tells the user which parts are bankable and which need a second look. - FACT, INFERENCE, and GUESS are visibly distinct, not smeared into one confident tone. - Confidence labels are spread across the range, not all clustered at "Medium" — they discriminate. - The shakiest part the decision depends on is called out, with a concrete way to firm it up.
Anti-patterns
- Uniform confidence: presenting a guess in the same assured voice as a fact. - Label inflation: tagging everything "High" so the labels carry no information. - Defensive hedging: slapping "Low confidence" on solid facts to avoid being pinned down. - Hiding a critical GUESS in the middle of confident prose. - Tagging but never explaining — "Medium" with no reason gives the user nothing to act on.
Example
Q: "Will this new dependency break our build on Node 18?" - "The library lists Node 18 in its supported engines." — FACT, High (it's in the published package metadata). - "So a clean install should work on your CI." — INFERENCE, Medium (follows from the above, but assumes your CI uses a standard install and no conflicting peer deps). - "Your existing webpack config probably won't need changes." — GUESS, Low (I haven't seen your config; this is just typical). To raise confidence: share the config and lockfile, or run the install in a throwaway branch. Headline: the one thing to actually test is the install in CI (the Medium/Low parts), not the support claim (the solid part).
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

