agentleFS
t1mericksont1merickson/skills/session-audit/SKILL.md

session-audit

Skill1 starsChanged 2 months agoMITView on GitHub

Audit Claude transcript history for repeated corrections, recurring workflows, and model-specific failures using a deterministic local extraction before judgment.

9 other projects use a version of this.

Adopted by

Most recently taken up by

The file

We split this skill into the rules it gives an agent

5 rules. 0 are common, 5 are distinctive, and 0 are very specific to this project.

  • 0

    Common

    Most of the 8 edited versions we read keep these.

  • 5

    Distinctive

    This author's own choices. Worth a look.

  • 0

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Use this skill only when invoked.

    line 8
  2. Distinctive:

    Use independent review lanes only when delegation is available and authorized.

    line 26
  3. Distinctive:

    always-relevant working contract → CLAUDE.md.

    line 32
  4. Distinctive:

    Run the reverse pass too: standing instructions that never affect behavior, duplicate stronger rules, or patch an obsolete model are …

    line 37
  5. Distinctive:

    Do not edit configuration during the audit.

    line 39

“Common” is measured: kept by at least 6 in 10 of the 8 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Session audit

Use this skill only when invoked. Transcript history is private evidence, not content to publish or quote at length.

Extract deterministically

Inspect one recent transcript to confirm the current schema, then use scripts/extract_transcripts.py to produce a bounded local corpus:

python3 scripts/extract_transcripts.py --limit 25 > /tmp/session-audit.jsonl

The extractor reads only, hashes source paths, and keeps messages in chronological order. Store its output in a temporary or user-approved local location. Never commit it.

Review three lenses

  1. Corrections: repeated complaints, redirects, reversals, and instructions the user had to restate.
  2. Workflows: multi-step work repeatedly explained from scratch; candidates for a skill or project instruction.
  3. Failure patterns: the user's next message signals overbuilding, verbosity, wrong interpretation, breakage, premature stopping, missing verification, or invention. Preserve model/version and date when present.

Use independent review lanes only when delegation is available and authorized; otherwise review the lenses sequentially. Short snippets may support a finding, but do not reproduce private conversations in the report.

Turn evidence into proposals

Rank findings by frequency, pain, and recency. Counts inform judgment rather than imposing an automatic threshold. Route each proposed change:

  • always-relevant working contract → CLAUDE.md;
  • project-specific convention → project instructions;
  • on-demand repeated workflow → skill;
  • failure isolated to one model generation → temporary routing or model note, not a permanent universal rule.

Run the reverse pass too: standing instructions that never affect behavior, duplicate stronger rules, or patch an obsolete model are deletion candidates.

Do not edit configuration during the audit. Present the evidence, proposed destination, and expected behavioral change; apply only after approval.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.