agentleFS
Jason-hub-starJason-hub-star/model-orchestrator/skills/harness-audit/SKILL.md

harness-audit

Skill0 starsChanged 2 months agoMITView on GitHub

Measure whether installed harness assets (skills, commands, templates) are actually invoked, using session logs rather than opinions, then archive dead assets, harvest improvements back to the template, and keep the installed set under the recovery-rate cap. Use for “which skills are unused”, “too many skills”, “harness check”, “why doesn't this skill trigger”, “정비”. Unlike absorb, this removes and consolidates what exists.

22 other projects use a version of this.

Adopted by

Most recently taken up by

Used with

Projects with it also use project-init, autopilot and 3 more.

Other files people use alongside this one.

Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
  • u9401066Skill

    project-init

    Initialize new projects using this template. Triggers: init, new, 新專案, 初始化, create project, 建立專案, bootstrap, scaffold project.

    Also in 3 projects that use this

  • ibahgatSkill

    autopilot

    Run autonomous multi-stage execution loops until acceptance criteria pass or blockers are reached.

    Also in 3 projects that use this

  • Microsoft AzureSkill

    test

    Also in 3 projects that use this

  • nicolasestremSkill

    brainstorm

    Structured idea generation and solution exploration with systematic analysis.

    Also in 3 projects that use this

  • GoogleSkill

    tdd

    Test-driven development. Use when the user wants to build features or fix bugs test-first, mentions "red-green-refactor", or wants integration tests.

    Also in 3 projects that use this

The file

We split this skill into the rules it gives an agent

1 rule. 0 are common, 1 is distinctive, and 0 are very specific to this project.

  • 0

    Common

    Most of the 18 edited versions we read keep these.

  • 1

    Distinctive

    This author's own choices. Worth a look.

  • 0

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Install selectively: Never push the whole template into a project.

    line 43

“Common” is measured: kept by at least 6 in 10 of the 18 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Harness Audit

Creating assets is easy; removing them is what nobody does. This stage checks one thing: were the assets we installed ever called?

Principles

  • Dead means zero invocations AND no entry point. Both conditions. A skill with no log hits can still be alive if a command names it or a living skill links to it; moving it breaks that path. Catalog listings (README, INDEX) do not count as entry points.
  • Two invocation paths. The model's Skill tool calls and the user's typed slash commands. Counting only one produces false deaths.
  • Modification time is not usage. Good skills are invoked for months without edits, and checkouts overwrite mtime anyway.
  • Templates are warehouses, not workers. Scaffold and template directories are expected to have zero invocations; measure recovery only in projects that do real work.
  • Read recovery rate together with session count. Zero sessions means the project is resting, not that its skills are dead.
  • Fewer installed assets recover better. One operator's measurement across 14 repositories (August 2026): projects holding 18 or fewer skills recovered 33–83% of them; projects holding 26–27 recovered 19–30%. This stage keeps the per-project set at 18 or fewer.

Run

python3 scripts/audit.py                 # current project against Claude Code session logs
python3 scripts/audit.py --root ~/code   # every project under a root
python3 scripts/audit.py --json

The script reports, per project: sessions, installed skills, invocations per skill (tool calls plus slash commands), entry points found in commands and other skills, and a verdict per skill (ALIVE, LINKED, DEAD). Session logs are read from ~/.claude/projects/**/*.jsonl; other runtimes need an adapter.

Reading the result

SignalMeaningAction
Recovery below 20%Skills compete and matching collapsedArchive dead ones first
Dead but zero sessionsProject is idleDo nothing
Global invocations far exceed localThe real workers are global skillsStop adding project skills
Copies of one skill differ across projectsSomeone fixed only one copyRestore the canonical one

Actions

  1. Archive dead skills with git mv into _archive/; never delete. Record the recovery numbers in the commit message.
  2. Harvest project-side improvements back into the shared template.
  3. Promote assets that exist identically in three or more projects into the template.
  4. Install selectively. Never push the whole template into a project; pick the shared commands plus what that project will actually call.

Pitfalls

  • A new check produces false positives first. Open three samples by hand before reporting a number; a false alarm hides the real ones.
  • Verdicts are only valid for the period the logs cover. A fresh machine makes everything look dead — the session column is the guard.
  • Logs can be gigabytes. Run wide audits in the background.

Next

A dead asset with no replacement goes to absorb. A dead asset that died because nobody knew when to call it needs an entry point (a ## Next baton or a command), not a rewrite.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.