ai-tool-watch
AGENTS.md11 starsChanged 4 months agoMITView on GitHub
docs/ is generated, not source. Every .html file under docs/, every API JSON under docs/api/v1/, plus docs/agents.json, docs/llms.txt, docs/sitemap.xml, docs/robots.txt, and docs/index.xml are produced by scripts/build.js. Direct edits to any generated docs/ file will be overwritten on the next build. scripts/prepare-publication.js is the finisher. Run it before committing any change to data/ or scripts/. There is no npm run build wrapper. prepare-publication.js chains the canonical sync, validation, build, generated-structure, and human/API/MCP coherence checks used by CI, then writes docs/publication-manifest.json and…
Where files are headingNew AGENTS.md files have more rules about keeping secrets out of the code, and fewer about code style.
Of the AGENTS.md files we read, the 31,774 first seen in the last six months, against the older ones: the kind of rule that gained most share, and the kind that lost most. About files like this in general, not this one, and an estimate, since a kind is a pattern in the words.
In this repository5 other files it gives its agents.
- CLAUDE.mdCLAUDE.md
- docs/llms.txtllms.txt
- capability-auditSkill
- capability-scannerSkill
- weekly-roundupSkill
The file
We split this AGENTS.md into the rules it gives an agent
3 rules. About 0 are common, 2 are distinctive, and 1 is very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈2
Distinctive · estimate
This author's own choices. Worth a look.
1
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Very specific: line 5
docs/is generated, not source: Every .html file under docs/, every API JSON under docs/api/v1/, plus docs/agents.json, docs/llms.txt, … - Distinctive: line 31
Run the test suite the way CI does:
- Distinctive: line 46
Always edit at the source level, then regenerate with the finisher:
≈ “Common” is an estimate: at least 1 in 5 of the 40,246 AGENTS.md files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
AI Tool Watch — agent instructions
Build pipeline — IMPORTANT for agents
docs/ is generated, not source. Every .html file under docs/, every API JSON under docs/api/v1/, plus docs/agents.json, docs/llms.txt, docs/sitemap.xml, docs/robots.txt, and docs/index.xml are produced by scripts/build.js. Direct edits to any generated docs/ file will be overwritten on the next build.
scripts/prepare-publication.js is the finisher. Run it before committing any change to data/ or scripts/. There is no npm run build wrapper. prepare-publication.js chains the canonical sync, validation, build, generated-structure, and human/API/MCP coherence checks used by CI, then writes docs/publication-manifest.json and verifies the artifact against it:
node scripts/prepare-publication.jsscripts/build.js does not write docs/publication-manifest.json — only prepare-publication.js does. Running the individual scripts and committing leaves the manifest holding hashes from the previous build, and tests/publication-manifest.test.js then fails in CI.
That failure names the wrong file. The test tampers with index.html and expects artifact hash mismatch for index.html, but scripts/verify-publication-manifest.js reports whichever manifest entry mismatches first in sorted order. With a stale manifest the reported path is normally agents.json, which reads like an agents.json bug. It is not. Re-run node scripts/prepare-publication.js and commit the regenerated manifest.
The individual scripts remain useful while developing and diagnosing a change:
node scripts/sync-evidence.js # Sync canonical evidence records
node scripts/validate-ontology.js # Validate cross-record integrity
node scripts/validate-claims.js # Talking-point prose vs structured fields
node scripts/build.js # Generate docs/ (no publication manifest)
node scripts/validate-structured-data.js # Parse/shape-check generated JSON-LD
node scripts/validate-publication.js # Human, API, and MCP coherence
node scripts/verify-features.js # Multi-model verification cascade
node scripts/check-links.js # Link integrity check
node scripts/scan-secrets.js # Secret scanRun the test suite the way CI does:
node scripts/test-offline.jsPlain node --test tests/ does not work: it picks up tests/smoke-live.test.js, which requires live third-party network access. scripts/test-offline.js excludes that file and runs the rest.
Key templates inside scripts/build.js:
renderSharedFooter()near line 1127 — site-wide footer (copyright, social, Substack/LinkedIn/Every AI Law links)- Multiple inline
OrganizationJSON-LD blocks (search for"@id": "https://snapsynapse.com/#organization") — publisher schema across page types agents.jsongenerator near line 4602 —maintainerfield at line 4620llms.txtgenerator near line 4498
Always edit at the source level, then regenerate with the finisher:
# After editing scripts/build.js or data/
node scripts/prepare-publication.js
git add scripts/ data/ docs/ # commit source AND its outputs togetherSafe to edit directly: LICENSE, README.md, data/ (source data), skills/ (skill bundles), scripts/ themselves, .github/, assets/ source. When in doubt, grep scripts/build.js for the file path before editing.
Stewardship and use
AI Tool Watch is an open reference under Snap Synapse LLC stewardship, authored by Sam Rogers. The reference is MIT-licensed and free for any use. Purpose, invariants, and scope decisions are in INTENT.md, which is authoritative for this repository.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

