harness-refresh
Skill4 starsChanged 2 months agoApache-2.0View on GitHub
Re-derive the agent-harness configuration knowledge from upstream documentation and report what changed since the last pass. Updates the reference files that /harness-audit reads and appends a dated entry to the verification log. Use when the user says "refresh the harness research", "is this still accurate", "check for new claude code features", "update the audit references", or before running /harness-audit on something important after a gap of weeks. Does not touch any repository's configuration.
In this repository19 other files it gives its agents.
- AGENTS.mdAGENTS.md
- CLAUDE.mdCLAUDE.md
- autonomous-prepSkill
- autonomous-sessionSkill
- backlogSkill
- check-buildSkill
- copilot-test-setupSkill
- daily-reviewSkill
- e2e-loopSkill
- handoffSkill
- harness-auditSkill
- night-briefingSkill
- openspec-apply-changeSkill
- openspec-archive-changeSkill
- openspec-exploreSkill
- openspec-proposeSkill
- openspec-sync-specsSkill
- resumeSkill
- review-iterationSkill
The file
We split this skill into the rules it gives an agent
8 rules. About 0 are common, 5 are distinctive, and 3 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈5
Distinctive · estimate
This author's own choices. Worth a look.
3
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 19
Run this in a forked or fresh context when possible.
- Very specific: line 24
Read ResearchClub/agent-harness-configuration/verification-log.md and note the date, the CLI version, and the "known gaps" list from the …
- Very specific: line 38
Start from the documentation index (llms.txt where the vendor publishes one) rather than assuming the URL list is still complete — new …
- Distinctive: line 62
Add new surface only where it changes a recommendation.
- Distinctive: line 64
Keep the reference files at reference length.
- Distinctive: line 72
Never edit a previous entry.
- Distinctive: line 87
If a correction invalidates advice the user has already applied somewhere, say so plainly and name the fix.
- Very specific: line 103
After updating the source copies, re-run skills/install.sh so the installed copies match, and say that you did.
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Re-derive what /harness-audit knows, from primary sources, and report what moved.
This skill writes documentation, never configuration. It updates reference files and the
verification log. It does not audit a repository, does not edit .claude/, and does not touch
settings, hooks, or instruction files. If the user wants a repo changed, that is
/harness-audit.
Primary sources only. Official documentation is authoritative. Vendor blog and support content is second tier — useful for how the tool's own team works, but its numbers are usually unmethodical. Community writing is third tier and is used only to generate questions to check against the docs, never as a citation. Label every tier explicitly in the log; the value of this skill is that a future reader knows how much to trust each line.
Run this in a forked or fresh context when possible. It is a research fan-out, and its output is a small diff — exactly the shape that should not consume a working session's window.
Step 1 — Establish the baseline
Read ResearchClub/agent-harness-configuration/verification-log.md and note the date, the CLI
version, and the "known gaps" list from the most recent entry. Determine the current CLI
version (claude --version or equivalent). State the delta out loud: "last verified at X on
DATE, now on Y" — that span is what you are looking for changes within.
Step 2 — Re-derive from the docs
Fetch the pages that back the reference files. The current set:
features-overview · memory · skills · sub-agents · hooks
permissions · settings · context-window · costs · agent-teams · commandsStart from the documentation index (llms.txt where the vendor publishes one) rather than
assuming the URL list is still complete — new pages are how new features arrive.
For each, compare against ResearchClub/agent-harness-configuration/claude-code-reference.md
and the audit skill's references/. You are looking for four things:
- Contradictions — something stated that the reference now gets wrong. Highest priority.
- Version gates — behaviour that changed in a version between the baseline and now, and whether the user's current version is on the new or old side of it.
- New surface — commands, hook events, frontmatter fields, settings keys that did not exist.
- Closed gaps — items from the previous entry's "known gaps" that are now documented.
Step 3 — Chase the open gaps
Work the previous entry's "known gaps" list explicitly. Carrying a gap forward unexamined for several passes is how a research file quietly stops being research. If a gap is still undocumented after being checked, say so and keep it — that is a finding about the vendor's docs, not a failure.
Step 4 — Update, conservatively
- Correct anything contradicted. Note the correction in the log, do not just overwrite it — what was wrong, and what it should have been, is the most useful thing in the file.
- Add new surface only where it changes a recommendation. A new command that nobody would act on is noise; a new hook event that makes a previously unenforceable rule enforceable is not.
- Keep the reference files at reference length. If one is growing past usefulness, split it or cut what has stopped earning its place — these files are read into a working context, so the same economics being documented apply to them.
- Preserve version annotations.
(v2.1.218+)on a claim is what lets the next reader decide whether it applies to them.
Step 5 — Append to the verification log
Never edit a previous entry. Append a new dated block containing:
- date, CLI version, platform, method
- sources used, grouped by confidence tier
- corrections this pass produced — the section that matters most
- new surface worth acting on
- overlap discovered with shipped built-ins, if any — a feature that now does something the audit skill hand-rolls should be delegated to, and the skill trimmed
- known gaps carried forward or newly opened
Step 6 — Report the diff, not the research
The deliverable is short: what changed, what it means for /harness-audit, and whether anything
previously recommended is now wrong. Do not restate what stayed the same.
If a correction invalidates advice the user has already applied somewhere, say so plainly and name the fix. That is the single most valuable output this skill produces.
Files this skill owns
ResearchClub/agent-harness-configuration/claude-code-reference.md
ResearchClub/agent-harness-configuration/cross-agent-portability.md
ResearchClub/agent-harness-configuration/verification-log.md (append-only)
skills/harness-audit/references/claude-code.md
skills/harness-audit/references/cross-agent.mdextension-model.md and heuristics.md are reasoning, not mechanics — change them only when a
source contradicts the reasoning itself, not merely when a version bumps.
After updating the source copies, re-run skills/install.sh so the installed copies match, and
say that you did.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

