agentleFS
ronaknnathanironaknnathani/relay/skills/validate/SKILL.md

validate

Skill43 starsChanged 4 months agoMITView on GitHub

Verify a change is ready to ship by checking it against its acceptance criteria and running the repo's own quality gates in order, then report a pass/fail verdict with the exact failures. Use to decide go/no-go right before shipping — when you want a pass/fail verdict against acceptance criteria and the repo's quality gates (lint/build/test), not a code critique (use `review` for that). It reports — it does not fix (route failures to `pr-fix`/`implement`) and does not ship.

63 other projects use a version of this.

Adopted by

Most recently taken up by

Used with

Projects with it also use policy-init, create and 9 more.

Other files people use alongside this one.

Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
  • open-coder-aiSkill

    policy-init

    Create conformant Chock policy from request. args(request, target_path,

    Also in 3 projects that use this

  • MicrosoftSkill

    create

    Also in 4 projects that use this

  • HermeticOrmusSkill

    close

    End-of-session ritual. Captures session state, updates auto-memory, writes a session summary, then exits the session cleanly.

    Also in 4 projects that use this

  • Hugging FaceSkill

    sprint

    Work on a batch of GitHub issues in parallel using Agent Teams. Creates one worktree per issue with TDD enforcement, coordinates via a lead agent, then produces stacked PRs.

    Also in 4 projects that use this

  • qtzx06Skill

    eval

    Evaluate trained YOLO model accuracy with mAP metrics and per-class error analysis. Identifies failure cases for targeted improvement. Use after training.

    Also in 4 projects that use this

  • csiddhant796-blipSkill

    board

    Read, write, and browse the AgentHub message board for agent coordination.

    Also in 3 projects that use this

The file

We split this skill into the rules it gives an agent

1 rule. 0 are common, 0 are distinctive, and 1 is very specific to this project.

  • 0

    Common

    Most of the 53 edited versions we read keep these.

  • 0

    Distinctive

    This author's own choices. Worth a look.

  • 1

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Very specific:

    Gather the acceptance criteria: Read the Success criteria from the clarify/plan artifacts.

    line 16

“Common” is measured: kept by at least 6 in 10 of the 53 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Validate

Decide whether a change is ready to ship and report the verdict — pass, or fail with the exact failures someone else can act on. The bar: every acceptance criterion from clarify/plan is demonstrably met, and every quality gate the repo defines is green, each shown by a command or observation rather than asserted. This skill is a gate, not a fixer: on failure it hands precise error-feedback to pr-fix or implement and stops. It does not edit code and does not ship.

Process

  1. Gather the acceptance criteria. Read the Success criteria from the clarify/plan artifacts. These are the goal-backward targets — what must be TRUE about the codebase. If no artifact exists, reconstruct the criteria from the task description and list them, so the verdict is checkable.
  2. Discover the repo's own gate commands. Find how this repo lints, type-checks, tests, builds, and audits — from its scripts/manifest/CI config (explore when it isn't obvious). Use the repo's actual commands; never substitute a generic command or invent a gate the repo doesn't define. A gate the repo doesn't have is skipped as not-applicable (and noted), not faked.
  3. Run every applicable quality gate — none skippable. The gates, in report order: lint → typecheck → unit tests → build → integration → e2e → security/audit → bundle-size. This sequence is the reporting/intent order, not a stop-on-first-failure barrier: run independent gates in parallel when the tooling allows (dispatch sub-agents when available; otherwise inline), never stop at the first failure, and capture every gate's output so the report is complete in one pass.
  4. Check each acceptance criterion, goal-backward. For each criterion, name the test, command, or direct observation that demonstrates it holds — and run/observe it. A criterion with no evidence is a FAIL, not a pass-by-assertion; "looks done" is not evidence.
  5. Render the verdict. PASS only if every applicable gate is green AND every acceptance criterion has passing evidence. Otherwise FAIL. Report, for each failure: the exact command run, its error output, and the location (file/line/criterion) — this is the error-feedback pr-fix or implement consumes. Do not attempt deep fixes here; a one-line obvious typo is still routed out, not silently patched.

Never mask a failure to go green

Disabling a test, skipping a spec, loosening a lint rule, or lowering a threshold to make a gate pass is a hard red flag — it converts a real failure into a hidden one. If a gate fails, report it as a FAIL with its evidence and route it out. The only legitimate "skip" is a gate the repo genuinely does not define, recorded as not-applicable.

Output schema (the verdict)

# Validation: <task>  — VERDICT: PASS | FAIL
## Gates
  - <gate>: PASS | FAIL | N/A — `<exact command>`  (on FAIL: error + location)
## Acceptance criteria
  - [x] <criterion> — evidence: <test/command/observation>
  - [ ] <criterion> — FAIL: <what's missing + where>
## Failures (for pr-fix / implement)
  - `<exact command>` → <error output> @ <file:line | criterion>

A PASS verdict means nothing in the Failures section. List every failure, not just the first — one pass should give the fixer everything to act on.

Red flags

  • Skipping a gate that applies, or running them out of order, instead of the full lint→…→bundle-size sequence.
  • Disabling/loosening a test, spec, lint rule, or threshold to turn a gate green.
  • Substituting a generic command for the repo's own gate command, or inventing a gate the repo lacks.
  • Marking an acceptance criterion PASS without a test/command/observation behind it.
  • Editing code to fix a failure here instead of routing it to pr-fix/implement.
  • Reporting only the first failure when later gates also failed — the fixer needs the whole set.
  • Shipping, merging, or invoking the next skill — validate returns a verdict and stops.

Verification checklist

  • Acceptance criteria came from the clarify/plan artifact (or were reconstructed and listed).
  • Gate commands are the repo's own, discovered from its config — not generic or invented.
  • Every applicable gate ran in order; results captured; none skipped or masked to go green.
  • Each acceptance criterion is backed by a named test/command/observation, not assertion.
  • The verdict is PASS only with all gates green and all criteria evidenced; else FAIL.
  • Each failure reports exact command + error + location for pr-fix/implement to consume.
  • No code was edited, nothing was shipped, and no next skill was invoked.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.