docs-review
Skill354 starsChanged todayApache-2.0View on GitHub
Review documentation for accuracy, completeness, and consistency against the actual codebase.
We split this skill into the rules it gives an agent
12 rules. 0 are common, 8 are distinctive, and 4 are very specific to this project.
0
Common
Most of the 21 edited versions we read keep these.
8
Distinctive
This author's own choices. Worth a look.
4
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 11
Don't waste time on these—CI and pre-commit hooks handle them:
- Distinctive: line 26
Consistency: Do different docs contradict each other or repeat the same fact?
- Distinctive: line 41
Look for new features, changed defaults, renamed options, or removed functionality.
- Distinctive: line 46
Do not rely on a fixed list of files.
- Distinctive: line 59
Every public config field has one owning reference with accurate type, default, constraints, inheritance, and prerequisites
- Very specific: line 70
Check docs/architecture/, including the module rows in docs/architecture/code-map.md:
- Very specific: line 72
No important source modules are missing from the code map.
- Distinctive: line 83
Look for docs that describe features the code no longer has, or code with features the docs don't cover.
- Distinctive: line 90
Do examples use current syntax (not deprecated options)?
- Very specific: line 91
Do setup snippets reference real files/flags/commands that exist in this repo/CLI?
- Distinctive: line 92
Do NOT flag AI model names as invalid based on your training cutoff — look them up online first
- Very specific: line 102
Check docs/deployment/ files against actual Dockerfiles, Helm charts, scripts, and environment variable defaults in …
“Common” is measured: kept by at least 6 in 10 of the 21 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Review documentation for accuracy, completeness, relevance, and consistency. Focus on things that require judgment—automated checks handle the rest.
The Documentation Policy in AGENTS.md defines who reads docs/ and what belongs there.
What's Already Automated
Don't waste time on these—CI and pre-commit hooks handle them:
- README CLI output:
markdown-code-runnerregenerates CLI help blocks viadocs/run_markdown_code_runner.py - Linting/formatting: Handled by pre-commit
What This Review Is For
Focus on things that require judgment:
- Accuracy: Does the documentation match what the code actually does?
- Completeness: Are there undocumented features, config options, user-visible behaviors, or operator procedures?
In user docs, internal limits, hardening, and failure or recovery paths are gaps only when a user would plausibly ask about them;
docs/architecture/pages keep the inventories AGENTS.md requires complete. - Relevance: Does every sentence in user docs pass the Documentation Policy, or does it describe implementation mechanics or change history?
docs/architecture/pages and the design records indocs/dev/hold only what the code cannot show, as the AGENTS.md Documentation Policy lists; outside the inventories AGENTS.md requires, a sentence there that describes what the code does is a finding. - Clarity: Would a MindRoom agent answering a user question find and apply this? Are examples realistic?
- Consistency: Do different docs contradict each other or repeat the same fact?
- Freshness: Has the code changed in ways the docs don't reflect?
Review Process
1. Check Recent Changes
# What changed recently that might need doc updates?
git log --oneline -20 | grep -iE "feat|fix|add|remove|change|option"
# What code files changed?
git diff --name-only HEAD~20 | grep "\.py$"Look for new features, changed defaults, renamed options, or removed functionality.
2. Verify Configuration Docs Against Code
Compare docs under docs/configuration/ against the Pydantic models in the src/mindroom/config/ package, whose root model is in src/mindroom/config/main.py.
Do not rely on a fixed list of files; discover what exists in both locations and check they match.
# Find every config class declaration, including indirect Pydantic subclasses
rg -n "^class " src/mindroom/config
# Find all config doc files
ls docs/configuration/Trace inheritance for every discovered class instead of assuming each Pydantic model directly subclasses BaseModel.
Check:
- Every public config field has one owning reference with accurate type, default, constraints, inheritance, and prerequisites
- Internal models need no docs just because they exist
- Example YAML would actually work
3. Verify Architecture Docs Against Source
# What source files actually exist?
git ls-files "src/mindroom/**/*.py"Check docs/architecture/, including the module rows in docs/architecture/code-map.md:
- Listed modules exist and descriptions match what the code does
- No important source modules are missing from the code map; the other
docs/architecture/pages record reasons, invariants, and required inventories, not module walkthroughs or data flow
4. Verify Feature Docs Against Implementation
For every doc file under docs/, find the corresponding source module(s) and check they agree. Don't assume a fixed mapping — discover it:
ls docs/*.md docs/*/
ls src/mindroom/*.py src/mindroom/*/Look for docs that describe features the code no longer has, or code with features the docs don't cover.
5. Check Examples
For examples in any doc:
- Would the
config.yamlsnippets actually work? - Are names and references realistic and current?
- Do examples use current syntax (not deprecated options)?
- Do setup snippets reference real files/flags/commands that exist in this repo/CLI?
- Do NOT flag AI model names as invalid based on your training cutoff — look them up online first
6. Cross-Reference Consistency
The same info appears in multiple places. Check for conflicts between README.md, docs/, and AGENTS.md.
Also verify that script paths and file references in AGENTS.md and docs/deployment/ match the actual filesystem layout.
6b. Verify Deployment Docs
Check docs/deployment/ files against actual Dockerfiles, Helm charts, scripts, and environment variable defaults in src/mindroom/constants.py.
7. Self-Check This Prompt
This prompt can become outdated too. If you notice:
- New automated checks that should be listed above
- New doc files that need review guidelines
- Patterns that caused issues
Include prompt updates in your fixes.
Output Format
Categorize findings:
- Critical: Wrong info that would break user workflows
- Inaccuracy: Technical errors (wrong defaults, paths, types)
- Missing: Undocumented features or options
- Irrelevant: Implementation mechanics, change history, or repeated facts to remove
- Outdated: Was true, no longer is
- Inconsistency: Docs contradict each other
- Minor: Typos, unclear wording
For each issue, provide a ready-to-apply fix:
### Issue: [Brief description]
- **File**: path/to/file.md:42
- **Problem**: What's wrong
- **Fix**: What to change
- **Verify**: How to confirmOther versions22 projects use a version of this.
Word for word · 0
None found.
Edited · 0
None found.
Wrote their own version · 22
- storybookjs/storybook★ 91ksame name
- metabase/metabase★ 50ksame name
- grafana/tempo★ 5.5ksame name
- graphistry/pygraphistry★ 2.6ksame name
- perber/leafwiki★ 1.2ksame name
- jtenniswood/espcontrol★ 1.1ksame name
- getsentry/sentry-rust★ 755same name
- Harry-kp/vortix★ 718same name
- getsentry/sentry-docs★ 449same name
- langchain-ai/docs★ 443same name
12 more not listed
How matches are found. Word for word: the exact same text. Edited: shares passages with this file (“99% same” means 99% of its five-word phrases also appear here; 10% or more counts). Their own version: similar meaning, or, weakest, the same name. We can’t tell which project had it first. Projects are counted among the 200 most-starred candidates, and mentions are links to the repository we found, up to 50 per site, so both counts are a floor.
In this repository14 other files it gives its agents.
- AGENTS.mdAGENTS.md
- skills/mindroom-docs/references/llms-full.txtllms.txt
- skills/mindroom-docs/references/llms.txtllms.txt
- address-pr-review-commentsSkill
- agent-cli-devSkill
- agent-cli-tmux-supervisionSkill
- code-debateSkill
- duplication-auditSkill
- live-testSkill
- native-subagent-pr-loopSkill
- pr-reviewSkill
- agent-conversationsSkill
- mindroom-docsSkill
- open-knowledge-formatSkill
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
Reviews can't be read right now.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

