agentleFS
odinfreeodinfree/storm-ecdsa-harness/skills/cross-model-review-gate/SKILL.md

cross-model-review-gate

Skill4 starsChanged 20 days agoMITView on GitHub

Two-model review before an irreversible step. A reviewer from a second lab checks the work, and every review is recorded against the exact commit and artifact hash. Learned from gnuchev's Open Research Club (a Claude author, an OpenAI reviewer, about three rounds per artifact). Use before submitting a structural benchmark row, publishing a tool or skill, declaring a route dead, or deploying.

The file

We split this skill into the rules it gives an agent

2 rules. About 0 are common, 1 is distinctive, and 1 is very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈1

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 1

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Very specific:

    Run the reviewer read-only at its highest effort: a second CLI agent from another lab, or a Claude Fable subagent (model: "fable".

    line 40
  2. Distinctive:

    Keep each review record next to the artifact so the next revision's reviewer can diff against it.

    line 42

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Cross-model review gate

A receipt is one reviewer's record of exactly what it checked about one exact revision. It reports checks; it does not certify the claim. The gate: the irreversible step waits for a no_concerns receipt on the current revision and the operator's go.

Loop

  1. Author commits the artifact. Record the commit id and every artifact hash the claim rests on (e.g. ops.bin sha256, note file hash).
  2. Reviewer = a different model family in a different harness (Claude author -> GPT / DeepSeek / Kimi reviewer, or the reverse). Brief it adversarially ("refute this or name what was missed") with paths, not conclusions. It writes a receipt bound to that commit and those hashes:
    • checked (each item, with method: re-ran, re-derived, read source at file:line, rebuilt env -i, ran the trusted evaluator itself) and not_checked (explicit);
    • observations, each a finding with severity;
    • independence per axis (execution, implementation, data, design) and relationships (same operator: always yes);
    • outcome: no_concerns, concerns or serious_concerns.
  3. Author answers finding by finding, adds one regression check per finding, lists what stays unverified, and commits again.
  4. Reviewer rechecks at the new commit (only the delta plus the regression checks). Loop until no_concerns; about three rounds is normal.
  5. Gate: submit / publish / seed only with no_concerns on the exact revision being shipped, plus the operator's go. A changed byte means a new revision and a new receipt.

Benchmark variant (ecdsa.fail)

The strongest receipt is an independent rebuild: the reviewer rebuilds env -i from the committed defaults, checks the ops sha256, runs the evaluator itself, and runs a fixed-input A/B against the parent. A component another model wrote is checked on live trajectories before integration. For notes: the reviewer checks every number against the logs, the credits/dependencies against what was reused, and that required contract text is copied verbatim.

Wiring

Run the reviewer read-only at its highest effort: a second CLI agent from another lab, or a Claude Fable subagent (model: "fable"; confirm the transcript reports the model you asked for, since a silent fallback voids the review). Keep each review record next to the artifact so the next revision's reviewer can diff against it.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.