agentleFS
Curious-KeeperCurious-Keeper/skills/maintain-verification-skill/SKILL.md

maintain-verification-skill

Skill1 starsChanged 57 days agoMITView on GitHub

Periodic pass that keeps a project's verification skill and feature map honest: parallel source readers per feature, one live session driving every feature, at most one PR of proven corrections. Use when auditing or refreshing an existing verification skill, or after the app has changed enough that its feature map may have rotted.

68 other projects use a version of this, 58 of them edited.

Adopted by

Most recently taken up by

Used with

Projects with it also use setup-pstack, ketchup-video and 10 more.

Other files people use alongside this one.

Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
  • bnemaSkill

    setup-pstack

    Configure which Pi models pstack uses per role. Detects available provider/model specs and writes pstack's user configuration. Use for /setup-pstack, "configure pstack models", or changing pstack model choices.

    Also in 25 projects that use this

  • tristanphvnSkill

    ketchup-video

    Catch the user up like /keel:ketchup, with a short silent video of slides for what happened and the waiting calls as text under it. Use for /keel:ketchup-video.

    Also in 13 projects that use this

  • ianclearySkill

    poteto-help

    Guides users through pstack setup, /poteto-mode, and picking the skill, playbook, or principle for a task. Type /poteto-help with a question.

    Also in 14 projects that use this

  • eryzerzSkill

    make-bot-ui

    Use when building a custom UI (page, dashboard, buttons) that should wake a Grok Bot over a webhook, when the user must provide a webhook sender key, or when exposing that UI on Tailscale.

    Also in 19 projects that use this

  • ianclearySkill

    principle-explain-the-number

    Apply before you trust, report, or act on a number you measured: a speedup, a regression, a throughput, a latency, or an eval result. Find what limits it, and rule out that it measured something other than the work you think.

    Also in 27 projects that use this

  • drafaelSkill

    in-your-own-words

    Restate the user's goals and the problem they are trying to solve to check understanding. Manual invocation only; use when the user explicitly invokes in-your-own-words or requests this understanding check. Do not solve the task or rewrite the assistant's last answer.

    Also in 26 projects that use this

The file

We split this skill into the rules it gives an agent

4 rules. 2 are common, 2 are distinctive, and 0 are very specific to this project.

  • 2

    Common

    Most of the 68 edited versions we read keep these.

  • 2

    Distinctive

    This author's own choices. Worth a look.

  • 0

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    clean: Every feature got source and live coverage, and nothing is worth shipping.

    line 15
  2. Common:

    Read the feature map README and glob its sibling files.

    line 31
  3. Distinctive:

    Evidence captured so far survives every cleanup: Check it at its named location rather than assuming it.

    line 50
  4. Common:

    Keep concise run notes in a scratch location, covering features covered, unreachable prerequisites, confirmed drift, and the outcome.

    line 69

“Common” is measured: kept by at least 6 in 10 of the 68 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Maintain a verification skill

A feature map rots the moment the app changes. This skill is the upkeep loop for a skill generated by create-verification-skill, or for any project-local verification skill with a feature map. The unit of rigor is the feature, not every sentence: cover every feature file from source and exercise every feature live, without turning every bullet into its own terminal command.

Outcomes

Pick one, and say which:

  • clean. Every feature got source and live coverage, and nothing is worth shipping. No branch, no PR.
  • changed. One PR ships proven doc, harness, or map corrections.
  • blocked. Coverage could not finish, or a proven fix could not ship safely. Say exactly what blocked it.

Edit scope

Only edit the verification skill's own directory: its SKILL.md, its features/, and any harness scripts it owns. Never edit product code during a run. A behavior the map describes that the app no longer does is either doc drift, which you fix in the map, or a product regression, which you report rather than paper over in docs.

Pass

0. Locate the target

Find the verification skill to maintain: the project-local skill whose body has launch and drive sections and a feature map. Look wherever this project keeps its skills, for a directory named for verifying the app. With several candidates, ask which one. With none, stop and call the Skill tool for create-verification-skill instead of inventing a target.

1. Index hygiene

Read the feature map README and glob its sibling files. Fix missing, extra, duplicate, or dead entries. Keep this lightweight. No generated inventory.

2. Source wave

Launch one read-only sub-agent per feature file, concurrently. Each one explains how the user-facing feature works from source, flags likely doc drift with citations, and returns one concise live-verification recipe. Children never drive the app and never edit files.

Return shape: feature summary, source entry points, likely drift or none, one recipe.

3. Reconcile

Every feature file has a returned summary. Merge overlapping recipes into as few app states as practical. Spot-check cited drift and do not re-prove clean claims. Sweep recent churn for user-facing surfaces missing from the map, and require a concrete source path before calling one missing.

4. Live pass

Required even when source looks clean. The coordinator owns all driving. Follow the verification skill's own launch model: one long-lived instance driven serially for servers and UIs, or a fresh isolated session per drive for short-lived CLIs. That skill's Launch section decides, not this one.

Exercise every feature at least once, and hold three invariants for the whole pass, whatever the failure:

  1. Never drive an instance you have not health-checked since it last did something surprising. Doctor before the first drive, doctor on each fresh session where sessions are the unit, and doctor again after any failed drive. Where doctor cannot see the failure, such as a wedged UI state on a healthy process, reset to a known state or relaunch rather than hoping.
  2. Evidence captured so far survives every cleanup. Check it at its named location rather than assuming it.
  3. Nothing a drive started outlives that drive's usefulness. Failed-iteration residue is cleaned whether the session is stuck, exited, or shared. For a shared instance, clean the residue and not the instance.

A doctor failure caused by skill drift is drift. Fix it under edit scope and retry once, restarting whatever the fix invalidated and nothing more, before calling the pass blocked.

A feature that cannot be reached is verified-unreachable only with the concrete prerequisite (auth, entitlement, OS, external state) and the route attempted. If the map omits that prerequisite, that is drift.

Any harness fix from triage gets re-driven live before it ships. Final teardown happens after the last drive of the run, including those re-proofs, so nothing outlives the run. Evidence stays, per the skill.

5. Triage

  • A wrong or missing user-POV description is doc drift. Fix it.
  • Working behavior the harness cannot drive is a harness gap. Fix it. A harness fix follows the same helpers rule as generation: scripts executable, invocation documented in the skill body.
  • App behavior that is actually broken is a product gap. Record it for the user and keep it out of this PR.

6. Ship or stop

For changed, open one PR of proven corrections, re-reading every changed file first. For clean or blocked, open no PR and report the outcome and the coverage honestly.

Keep concise run notes in a scratch location, covering features covered, unreachable prerequisites, confirmed drift, and the outcome. Do not commit them.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

Reviews can't be read right now.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.