anthropic-doc-validator
Skill1 starsChanged 56 days agoMITView on GitHub
Validate claims, documentation, code examples, or generated content about Claude Code, the Anthropic API, or Anthropic SDKs against the latest official documentation. Use when the user asks to "validate against docs", "check against anthropic docs", "verify this is current", "is this still accurate", "audit content against documentation", or similar. Also use proactively after generating slides, READMEs, blog posts, training materials, or runbooks that make specific factual claims about Anthropic products, so that those claims do not drift from the source of truth.
In this repository64 other files it gives its agents.
- accioSkill
- archifySkill
- cavecrewSkill
- caveman-compressSkill
- caveman-exploreSkill
- caveman-helpSkill
- cavemanSkill
- codebase-designSkill
- conference-talk-deckSkill
- config-gcSkill
- context-budgetSkill
- domain-modelingSkill
- excalidrawSkill
- explain-yogi-like-he-is-5Skill
- field-guide-builderSkill
- gateguardSkill
- geo-contentSkill
- goal-creatorSkill
- grillingSkill
- grill-meSkill
- grill-with-docsSkill
- hindsightSkill
- implementSkill
- improve-codebase-architectureSkill
- loop-design-checkSkill
- mental-modelsSkill
- migrationSkill
- modern-pythonSkill
- no-ai-slopSkill
- onboard-lightSkill
- onboard-repoSkill
- ponytail-auditSkill
- ponytail-reviewSkill
- ponytailSkill
- primitive-classifierSkill
- prompt-fixerSkill
- prompt-optimizerSkill
- prototypeSkill
- qa-deckSkill
- read-wikiSkill
- researchSkill
- resolving-merge-conflictsSkill
- safe-refactorSkill
- scope-creep-checkSkill
- sdd-workshop-walkthroughSkill
- setup-matt-pocock-skillsSkill
- skill-complySkill
- skill-scoutSkill
- smellsSkill
- spec-interviewSkill
- surgical-patchSkill
- teachSkill
- the-llm-councilSkill
- to-questionnaireSkill
- to-specSkill
- to-ticketsSkill
- triageSkill
- wait-whatSkill
- watchSkill
- wayfinderSkill
- The first 60 shown.
The file
We split this skill into the rules it gives an agent
10 rules. About 0 are common, 7 are distinctive, and 3 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈7
Distinctive · estimate
This author's own choices. Worth a look.
3
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 13
If the user pointed at a file or section, read it.
- Distinctive: line 14
If the user pasted a claim, treat the message as the input.
- Very specific: line 17
Map each claim to the most likely doc page: Use the URL index below. If you are unsure, fetch https://code.claude.com/docs/llms.txt first …
- Very specific: line 19
Fetch the doc page with a specific, narrow prompt: Use WebFetch and ask for the exact passage that confirms or refutes the claim.
- Distinctive: line 28
Produce the report: Use the format in the Output section below.
- Very specific: line 34
Use these as your first stop.
- Distinctive: line 78
Write a prompt that asks for specific verifiable facts, not summary.
- Distinctive: line 135
Doc pages change: Always quote verbatim with a timestamp.
- Distinctive: line 137
Version-specific behavior: If a doc says "requires Claude Code v2.x.y or later", flag that the claim may only apply to recent installs.
- Distinctive: line 150
If the only available source is a community blog, say so explicitly in the report and downgrade the confidence rating.
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Validate content against the latest Anthropic documentation
When invoked, your job is to take a body of content (a file, a passage, a code sample, or a list of claims) and check each factual assertion against the current Anthropic docs. You produce a structured report. You do NOT silently fix things; you surface findings so the user can decide.
Workflow
- Identify what to validate.
- If the user pointed at a file or section, read it.
- If the user pasted a claim, treat the message as the input.
- Extract a list of discrete, factual, verifiable claims. Skip stylistic opinions and the user's own preferences.
- Map each claim to the most likely doc page. Use the URL index below. If you are unsure, fetch
https://code.claude.com/docs/llms.txtfirst to discover the index. - Fetch the doc page with a specific, narrow prompt. Use
WebFetchand ask for the exact passage that confirms or refutes the claim. Quote verbatim. Do not paraphrase the docs. - Compare claim vs. doc. Classify each finding as one of:
- Confirmed: doc quote supports the claim.
- Refuted: doc quote contradicts the claim. Include the corrected statement.
- Stale / changed: doc indicates the API or behavior has changed (deprecated, renamed, replaced).
- Not documented: doc page does not address the claim. Note that this does NOT mean the claim is wrong, only unverifiable from official docs.
- Ambiguous: doc text is consistent with multiple readings; flag for human judgment.
- Produce the report. Use the format in the Output section below.
- Do not modify the original content unless the user asks. Validation is read-only by default. If they say "fix it", apply the corrections; otherwise just report.
Anthropic documentation URL index
Use these as your first stop. Only fall back to WebSearch if a topic isn't covered here.
Claude Code (the CLI)
| Topic | URL |
| Doc index (truth source) | https://code.claude.com/docs/llms.txt |
| CLAUDE.md, rules, auto memory | https://code.claude.com/docs/en/memory |
| settings.json hierarchy, all settings keys | https://code.claude.com/docs/en/settings |
| Hooks (events, JSON payload, exit codes) | https://code.claude.com/docs/en/hooks |
| Skills (precedence, frontmatter, locations) | https://code.claude.com/docs/en/skills |
| MCP servers (scopes, precedence) | https://code.claude.com/docs/en/mcp |
| Permissions (allow/deny, sandbox) | https://code.claude.com/docs/en/permissions |
| Plugins | https://code.claude.com/docs/en/plugins |
| CLI flags, env vars | https://code.claude.com/docs/en/cli-reference |
| Subagents | https://code.claude.com/docs/en/sub-agents |
| Hooks guide (worked examples) | https://code.claude.com/docs/en/hooks-guide |
| Context window | https://code.claude.com/docs/en/context-window |
| Debug a config | https://code.claude.com/docs/en/debug-your-config |
| Features overview | https://code.claude.com/docs/en/features-overview |
Anthropic API / SDK
| Topic | URL |
| API docs root | https://docs.anthropic.com |
| Models (capabilities, IDs, deprecation) | https://docs.anthropic.com/en/docs/about-claude/models |
| Messages API | https://docs.anthropic.com/en/api/messages |
| Tool use | https://docs.anthropic.com/en/docs/build-with-claude/tool-use |
| Prompt caching | https://docs.anthropic.com/en/docs/build-with-claude/prompt-caching |
| Extended thinking | https://docs.anthropic.com/en/docs/build-with-claude/extended-thinking |
| Files API | https://docs.anthropic.com/en/docs/build-with-claude/files |
| Batch API | https://docs.anthropic.com/en/api/creating-message-batches |
| Citations | https://docs.anthropic.com/en/docs/build-with-claude/citations |
| Agent SDK (Python) | https://docs.anthropic.com/en/api/agent-sdk/python |
| Agent SDK (TypeScript) | https://docs.anthropic.com/en/api/agent-sdk/typescript |
GitHub repos (for known issues, feature requests)
- Claude Code:
https://github.com/anthropics/claude-code/issues - Anthropic SDKs: search via
ghCLI when needed
How to call WebFetch correctly
Write a prompt that asks for specific verifiable facts, not summary. Bad prompts produce paraphrased answers that drift. Good prompts ask for quotes.
Good prompt to WebFetch:
"Find documentation on
claudeMdExcludes. Quote VERBATIM the section that explains: (a) what JSON file it lives in, (b) whether patterns are matched against absolute or relative paths, (c) whether the setting works on managed-policy CLAUDE.md files."
Bad prompt:
"Tell me about claudeMdExcludes."
Output format
Produce a markdown report. One row per claim. Group by status.
# Validation report: <subject>
Validated against: <list of URLs fetched, with timestamps>
## Summary
- N confirmed
- N refuted
- N stale/changed
- N not documented
- N ambiguous
## Refuted (HIGHEST PRIORITY)
### Claim: "<exact quote of the claim from the content>"
**Status:** Refuted
**Doc text:** > "<verbatim quote from doc>"
**Source:** <URL>
**Correction:** <one-line statement of what the claim should say>
## Stale / changed
(same format as Refuted)
## Confirmed
### "<claim>"
**Source:** <URL>
**Doc text:** > "<verbatim quote>"
## Not documented
(list claims with brief note on what was checked)
## Ambiguous
(list claims with both readings and a recommendation for which to use)
## Recommended fixes
<numbered list of concrete textual changes the user could apply>Things to watch out for
- Doc pages change. Always quote verbatim with a timestamp. A correct answer from last week may be stale today.
- Feature requests vs shipped features. Some terms (e.g., env vars, settings keys) appear in GitHub issues as requests. Verify against the docs, not just search snippets.
- Version-specific behavior. If a doc says "requires Claude Code v2.x.y or later", flag that the claim may only apply to recent installs.
- API vs CLI confusion.
https://docs.anthropic.comcovers the API/SDK.https://code.claude.comcovers the CLI. They are different products; don't validate CLI claims against API docs. - Path matching is the #1 source of subtle bugs. Different settings use different conventions:
claudeMdExcludesmatches absolute paths;.claude/rules/paths:field matches relative paths. Always check. - Frontmatter keys are case-sensitive and exact. YAML formatting matters.
Scope limits
This skill validates against PUBLIC Anthropic documentation only. It does not validate:
- Third-party blog posts, even from well-known authors
- ClaudeLog, eesel, or community wikis (use as discovery aids, not source of truth)
- GitHub issue comments that are not from Anthropic staff
- Internal Anthropic docs you do not have access to
If the only available source is a community blog, say so explicitly in the report and downgrade the confidence rating.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

