solo-skill-audit
Skill18 starsChanged 4 months agoMITView on GitHub
Use when "audit skill", "review skill quality", "check skill", "skill score", "skill checklist", "is this skill good", or evaluating skill against best practices. Do NOT use for KB audits (/audit) or code review (/review).
In this repository62 other files it gives its agents.
- CLAUDE.mdCLAUDE.md
- solo-android-releaseSkill
- solo-apple-app-iconSkill
- solo-auditSkill
- solo-boardSkill
- solo-buildSkill
- solo-community-outreachSkill
- solo-content-genSkill
- solo-creator-growthSkill
- solo-customer-finderSkill
- solo-deep-researchSkill
- solo-deploySkill
- solo-diagnoseSkill
- solo-domainSkill
- solo-factorySkill
- solo-github-outreachSkill
- solo-gmail-cliSkill
- solo-grillSkill
- solo-hackathonSkill
- solo-humanizeSkill
- solo-i18nSkill
- solo-index-youtubeSkill
- solo-initSkill
- solo-ios-devSkill
- solo-ios-releaseSkill
- solo-kaggle-gpuSkill
- solo-kindleSkill
- solo-knowledgeSkill
- solo-landing-genSkill
- solo-launchSkill
- solo-legalSkill
- solo-memory-auditSkill
- solo-metrics-trackSkill
- solo-mirrorSkill
- solo-model-shrinkSkill
- solo-music-reels-cutSkill
- solo-open-datasetSkill
- solo-paperSkill
- solo-pdf-printSkill
- solo-pipelineSkill
- solo-planSkill
- solo-redditSkill
- solo-researchSkill
- solo-retroSkill
- solo-reviewSkill
- solo-scaffoldSkill
- solo-secretsSkill
- solo-seo-auditSkill
- solo-seo-cliSkill
- solo-setupSkill
- solo-sgrSkill
- solo-skill-shelfSkill
- solo-stem-splitSkill
- solo-streamSkill
- solo-supervoxSkill
- solo-swiftui-design-systemSkill
- solo-transcribeSkill
- solo-validateSkill
- solo-video-editSkill
- solo-video-promoSkill
- The first 60 shown.
The file
We split this skill into the rules it gives an agent
6 rules. About 0 are common, 3 are distinctive, and 3 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈3
Distinctive · estimate
This author's own choices. Worth a look.
3
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Very specific: line 29
If name: search skills/{name}/SKILL.md in current project, then ~/.claude/plugins//skills/{name}/SKILL.md
- Distinctive: line 30
If path: read directly
- Very specific: line 31
If empty: list available skills via Glob /skills/*/SKILL.md, ask via AskUserQuestion
- Distinctive: line 47
If score < 2: give one specific fix
- Distinctive: line 96
Run audit on each
- Very specific: line 111
Fix: Use full path to SKILL.md as argument.
≈ “Common” is an estimate: at least 1 in 5 of the 372,429 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
/skill-audit
Audit a skill against the quality checklist based on Anthropic's internal best practices for Claude Code skills. Reads the skill's SKILL.md, references/, scripts/, and evaluates across 12 dimensions.
Source: https://x.com/trq212/status/2033949937936085378
Checklist Reference
- Scoring rubric, 12 dimensions:
references/checklist.md - The levers the scores measure — invocation, information hierarchy, leading words, failure modes:
references/writing-skills.md - Term definitions used in findings:
references/skills-glossary.md
Steps
- Locate skill from
$ARGUMENTS:- If name: search
skills/{name}/SKILL.mdin current project, then~/.claude/plugins/**/skills/{name}/SKILL.md - If path: read directly
- If empty: list available skills via Glob
**/skills/*/SKILL.md, ask via AskUserQuestion
- If name: search
- Read skill contents (parallel):
SKILL.md— main skill filereferences/*— all reference files (if dir exists)scripts/*— all scripts (if dir exists)assets/*— all assets (if dir exists)- Count total lines of SKILL.md
- Read checklist from
references/checklist.md Evaluate each dimension — for every checklist item, assess based on what you read:
For each of the 12 dimensions:
- State what you found (evidence)
- Score 0, 1, or 2 (use rubric from checklist)
- If score < 2: give one specific fix
- Determine category — classify skill into one of 9 types from checklist. Flag if it straddles multiple.
- Failure-mode pass — read
references/writing-skills.md, then check the skill for each named failure mode. Quote the offending line for every hit; a hit with no quote is a guess:- No-op — a line the model already obeys by default. Test each sentence in isolation: does it change behaviour versus the default?
- Duplication — one meaning stated in more than one place.
- Sediment — stale lines describing behaviour, paths, or tools that no longer exist.
- Sprawl — long even after no-ops and duplication are removed; cure is disclosure into
references/, not deletion. - Negation — steering by prohibition where a positive target would work.
Don't use Xnames X;use Ydoesn't. - Premature completion — a step whose completion criterion can't distinguish done from not-done.
- Weak leading word — a description or body leaning on generic words instead of a compact pretrained concept the user actually types.
Output scorecard:
## Skill Audit: {skill-name} **Score:** {N}/24 (Grade: {A/B/C/D/F}) **Category:** {type} **SKILL.md:** {N} lines | **References:** {N} files | **Scripts:** {N} files | # | Dimension | Score | Notes | |---|-----------|-------|-------| | 1 | Category Fit | {0-2} | {one line} | | 2 | Description Quality | {0-2} | {one line} | | 3 | Progressive Disclosure | {0-2} | {one line} | | 4 | Gotchas | {0-2} | {one line} | | 5 | Don't State Obvious | {0-2} | {one line} | | 6 | Flexibility | {0-2} | {one line} | | 7 | Setup & Config | {0-2} | {one line} | | 8 | Memory & State | {0-2} | {one line} | | 9 | Scripts & Code | {0-2} | {one line} | | 10 | Allowed Tools | {0-2} | {one line} | | 11 | Argument Handling | {0-2} | {one line} | | 12 | Output & Artifacts | {0-2} | {one line} | ### Failure Modes {mode} — "{quoted line}" → {fix} (or "none found") ### Top 3 Fixes (highest impact) 1. {fix} 2. {fix} 3. {fix}- Batch mode — if
$ARGUMENTSis "all" or "*":- Find all skills via Glob
- Run audit on each
- Output summary table sorted by score (worst first)
- Identify common weaknesses across the set
Gotchas
- N/A dimensions still score 2 — if a skill genuinely doesn't need config/state/scripts, don't penalize it. Score N/A as 2. Only score 0-1 when the skill SHOULD have it but doesn't.
- Gotchas ≠ Common Issues — "Common Issues" is troubleshooting (reactive). Gotchas are preventive — things Claude would get WRONG by default. A skill with only "Common Issues" scores 1, not 2.
- Line count is a smell, not a rule — 500-line SKILL.md with no references is suspicious. But 400 lines of dense, non-obvious content is fine. Check if content COULD be extracted, not just if it's long.
- Description under 300 chars — long descriptions dilute the trigger signal. Claude scans ALL skill descriptions at session start. Shorter = sharper matching.
Common Issues
Can't find skill
Cause: Skill not in expected path or using different directory structure. Fix: Use full path to SKILL.md as argument. Or run with "all" to discover available skills.
Score seems unfair
Cause: Some dimensions don't apply to the skill type. Fix: N/A dimensions score 2. Re-read the rubric — it accounts for genuinely stateless or config-free skills.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

