cross-model-review-gate
Skill4 starsChanged 20 days agoMITView on GitHub
Two-model review before an irreversible step. A reviewer from a second lab checks the work, and every review is recorded against the exact commit and artifact hash. Learned from gnuchev's Open Research Club (a Claude author, an OpenAI reviewer, about three rounds per artifact). Use before submitting a structural benchmark row, publishing a tool or skill, declaring a route dead, or deploying.
In this repository34 other files it gives its agents.
- AGENTS.mdAGENTS.md
- accepted-proof-exact-retuneSkill
- beachhead-ratchetSkill
- circuit-edit-integration-safetySkill
- computer-algebra-oraclesSkill
- constraint-construction-searchSkill
- deepseek-pressure-testSkill
- ecdsafail-fastevalSkill
- ecdsafail-lowq-playbookSkill
- ecdsafail-oracle-loopSkill
- ecdsafail-pareto-ratchetSkill
- ecdsafail-scratch-dietSkill
- elicit-researchSkill
- exact-search-engineeringSkill
- fast-lean-proof-loopSkill
- hard-problem-contractSkill
- invariant-chartSkill
- jev-second-perspectiveSkill
- lean-arklib-proofsSkill
- lean-finite-certificate-splittingSkill
- mission-commandSkill
- nasqret-playbookSkill
- pip-disciplineSkill
- portable-source-assertionsSkill
- proximity-prize-campaignSkill
- proximity-prize-frontier-archaeologySkill
- research-loopSkill
- route-compare-probe-disciplineSkill
- rust-archive-build-bindingSkill
- send-to-claude-fableSkill
- shot-autopsySkill
- squares-in-squares-campaignSkill
- verify-paired-native-measurementsSkill
- verify-research-transferSkill
The file
We split this skill into the rules it gives an agent
2 rules. About 0 are common, 1 is distinctive, and 1 is very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈1
Distinctive · estimate
This author's own choices. Worth a look.
1
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Very specific: line 40
Run the reviewer read-only at its highest effort: a second CLI agent from another lab, or a Claude Fable subagent (model: "fable".
- Distinctive: line 42
Keep each review record next to the artifact so the next revision's reviewer can diff against it.
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Cross-model review gate
A receipt is one reviewer's record of exactly what it checked about one exact revision. It reports checks; it does
not certify the claim. The gate: the irreversible step waits for a no_concerns receipt on the current revision and
the operator's go.
Loop
- Author commits the artifact. Record the commit id and every artifact hash the claim rests on (e.g. ops.bin sha256, note file hash).
- Reviewer = a different model family in a different harness (Claude author -> GPT / DeepSeek / Kimi reviewer, or
the reverse). Brief it adversarially ("refute this or name what was missed") with paths, not conclusions. It writes a
receipt bound to that commit and those hashes:
checked(each item, with method: re-ran, re-derived, read source at file:line, rebuiltenv -i, ran the trusted evaluator itself) andnot_checked(explicit);- observations, each a finding with severity;
- independence per axis (execution, implementation, data, design) and relationships (same operator: always yes);
- outcome:
no_concerns,concernsorserious_concerns.
- Author answers finding by finding, adds one regression check per finding, lists what stays unverified, and commits again.
- Reviewer rechecks at the new commit (only the delta plus the regression checks). Loop until
no_concerns; about three rounds is normal. - Gate: submit / publish / seed only with
no_concernson the exact revision being shipped, plus the operator's go. A changed byte means a new revision and a new receipt.
Benchmark variant (ecdsa.fail)
The strongest receipt is an independent rebuild: the reviewer rebuilds env -i from the committed defaults, checks the
ops sha256, runs the evaluator itself, and runs a fixed-input A/B against the parent. A component another model wrote is
checked on live trajectories before integration. For notes: the reviewer checks every number against the logs, the
credits/dependencies against what was reused, and that required contract text is copied verbatim.
Wiring
Run the reviewer read-only at its highest effort: a second CLI agent from another lab, or a Claude Fable subagent
(model: "fable"; confirm the transcript reports the model you asked for, since a silent fallback voids the review).
Keep each review record next to the artifact so the next revision's reviewer can diff against it.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

