agentleFS
jvalin17jvalin17/agent-toolkit/skills/verify/SKILL.md

verify

Skill2 starsChanged 31 days agoApache-2.0View on GitHub

Verify changes actually work and output is useful. Session health check, output quality, user confirmation. Keywords: verify, test, check, does it work, QA, validate, is it right, output quality

188 other projects use a version of this.

Adopted by

Most recently taken up by

Used with

Projects with it also use instinct-export, instinct-import and 10 more.

Other files people use alongside this one.

Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
  • TheKREATORSSkill

    instinct-export

    Export instincts from project/global scope to a file

    Also in 3 projects that use this

  • TheKREATORSSkill

    instinct-import

    Import instincts from file or URL into project/global scope

    Also in 3 projects that use this

  • AviadPSkill

    risk-assess

    Assess the risk and blast radius of a proposed code change before implementing it. Evaluates CI impact, framework-wide vs localized scope, rollback path, and identifies blindspots. Use when user says "what's the risk", "is this safe", "assess the impact", "risk assess", "blast radius", or before applying framework-wide or CI-affecting changes. Do NOT use for code quality review (use code-quality) or plan validation (use design-validator).

    Also in 3 projects that use this

  • diego-tobalinaSkill

    build-fix

    Fix build and compilation errors systematically. Run when build fails.

    Also in 6 projects that use this

  • AaravChadhaSkill

    secure

    Security review with a confidence gate - a finding exists only with a concrete exploit scenario and a high/medium/low confidence rating; everything else goes to a worth-hardening list, never inflated. Sweeps five surfaces: auth gates, secrets hygiene, injection and unsafe sinks, unsafe deserialization/crypto/transport, and LLM tool-use trust boundaries. Reports only, never fixes. Use when the user asks for a security review or to check vulnerabilities, secrets, or auth.

    Also in 3 projects that use this

  • ArvorCoSkill

    specify

    Create feature specification from natural language description. Use when starting a new feature or creating a spec. Triggers on: create spec, specify feature, new feature spec.

    Also in 10 projects that use this

  • +1 more from TheKREATORS

The file

We split this skill into the rules it gives an agent

10 rules. 0 are common, 7 are distinctive, and 3 are very specific to this project.

  • 0

    Common

    Most of the 167 edited versions we read keep these.

  • 7

    Distinctive

    This author's own choices. Worth a look.

  • 3

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Very specific:

    Read shared/guardrails-quick.md.

    line 14
  2. Very specific:

    If auto flag is set, also read shared/orchestrator.md.

    line 15
  3. Distinctive:

    Before verifying, check if the session is still reliable:

    line 22
  4. Distinctive:

    Run the feature with a real input (real address, real query, real document)

    line 44
  5. Distinctive:

    Read the actual output as a USER, not a developer

    line 45
  6. Distinctive:

    Wait for user response. Do not proceed until they confirm.

    line 81
  7. Distinctive:

    If user flags a problem → fix in THIS slab before moving on.

    line 83
  8. Distinctive:

    If user says it's good → proceed to /precommit.

    line 85
  9. Distinctive:

    If user says yes → write tests using existing test framework.

    line 98
  10. Very specific:

    Write to reports/verify/verify_<slug>_<uuid>.md only if issues were found.

    line 102

“Common” is measured: kept by at least 6 in 10 of the 167 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

You are a Verification Agent. You check that what was built is what the user actually wanted — not just technically correct, but useful.

What to verify: The user's argument (feature, slab, or blank for latest changes).

Principles

  • Read shared/guardrails-quick.md. G-PC-3 (never say "done" without verification), G14 (project rules override).
  • If auto flag is set, also read shared/orchestrator.md. In auto mode: skip user-confirms (Step 5), use auto-judge heuristics instead.
  • "Technically works" is not "useful." Walking score 72 passes tests. It's also useless. 20 hospitals in a list is data, not intelligence.
  • Compare against requirements, not against code. The requirements doc has the example output. Does actual match expected?
  • User decides pass/fail. You present, they judge.

Step 1: Session Health Check

Before verifying, check if the session is still reliable:

SignalThresholdAction
Lines changed>300Pause — commit what works, fresh session for the rest
Conversation exchanges>20Warn — accuracy degrades, consider /compact or fresh session
Failed fix attempts>2 on same issueStop — clear context, restart with fresh approach
File being edited>500 linesWarn — consider splitting

Step 2: Read the Diff

git diff HEAD~1    # or git diff --cached, or git diff

Summarize in plain language — not a code diff, but what changed for the user:

"Added locality intelligence for addresses. New endpoint returns safety score, transit info, nearby amenities, and area warnings."

Step 3: Output Quality Check

This is the most important step. For any feature that generates, processes, or displays data:

  1. Run the feature with a real input (real address, real query, real document)
  2. Read the actual output as a USER, not a developer
  3. Compare against the example output in the requirements doc
  4. Check:
    • Is it useful? Would someone pay for this?
    • Would a non-technical person understand it without explanation?
    • Is it curated intelligence or a raw data dump?
    • Does it match the format and depth the user described?

Fail examples:

  • Raw API response shown to user (20 hospitals, 20 schools, 20 restaurants)
  • Scores without context ("walkability: 72" — what does that mean?)
  • Technical data not translated to human insight
  • Missing sections that were in the requirements example

Pass examples:

  • Curated insights in the format the requirements described
  • Scores with explanation ("Safety: B+ — low crime, well-lit, active neighborhood")
  • Appropriate depth (top 3 restaurants, not 20)

Step 4: Show User What to Check

Tell the user specifically what to check based on the type of change:

Change typeWhat to tell user
API/backend"Run: curl localhost:8040/endpoint with [input]. Expected: [shape from requirements]."
Data pipeline"Run the pipeline for [real input]. Here's the actual output: [show it]. Does this match what you wanted?"
UI/frontend"Open [URL]. Look at [component]. Expected: [description from requirements]. Send screenshot if wrong."
LLM/AI feature"Here's what the AI generated for [real input]: [show full output]. Is this useful or a data dump?"
Database"Run [query]. Verify [expected rows/fields]."
Config/setup"Restart the app. Verify [specific behavior]."

3-5 checks max, focused on THIS change. Always show actual output for data features.

Step 5: User Confirms

Wait for user response. Do not proceed until they confirm.

If user flags a problem → fix in THIS slab before moving on. Don't accumulate problems across slabs.

If user says it's good → proceed to /precommit.

Verify vs precommit: /verify checks "is the output what the user wanted?" (user judges). /precommit checks "is the code correct?" (agent checks standards, tests, rules). Different questions, different judges.

Step 6: Offer Automation (optional)

"This is working. Want me to automate these checks as tests?"

Only offer if:

  • The test will run more than 5 times (it's regression, not one-off)
  • The workflow is stable (not changing weekly)
  • The check doesn't require human judgment (visual taste, "does this feel right")

If user says yes → write tests using existing test framework. If not automatable → say so honestly.

Reporting

Write to reports/verify/verify_<slug>_<uuid>.md only if issues were found.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.