reproducibility
Skill0 starsChanged 44 days agoMITView on GitHub
Use when a number this repository pins might mean something different on a different Python, when a gate result is suspected of depending on the interpreter rather than on the mathematics, or before trusting any cross-machine comparison of an instrument's output. Classifies every sibling instrument's shard into the interpreter class it was measured under and fails when one falls outside the pinned table. Stdlib-only Python 3.10+, no network, no build step.
3 other projects use a version of this.
Adopted by
Most recently taken up by
- 00200200/repro-lenstheir own version, first seen Sep 27, 2026
- open-science-pillars/coretheir own version, first seen Sep 21, 2026
- ffsshhttiikk/opencode-agents-skillstheir own version, first seen Feb 28, 2026
Other versions3 projects use a version of this.
Word for word · 0
None found.
Edited · 0
None found.
Wrote their own version · 3
- 00200200/repro-lens★ 44same name
- ffsshhttiikk/opencode-agents-skills★ 2same name
- open-science-pillars/core★ 0same name
How matches are found. Word for word: the exact same text. Edited: shares passages with this file (“99% same” means 99% of its five-word phrases also appear here; 10% or more counts). Their own version: similar meaning, or, weakest, the same name. We can’t tell which project had it first. Projects are counted among the 200 most-starred candidates, and mentions are links to the repository we found, up to 50 per site, so both counts are a floor.
In this repository9 other files it gives its agents.
- AGENTS.mdAGENTS.md
- claim-ledgerSkill
- elohim-harnessSkill
- elohimSkill
- estimator-biasSkill
- invariant-hunterSkill
- pay-signalSkill
- precision-budgetSkill
- tolerance-proverSkill
The file
We split this skill into the rules it gives an agent
4 rules. About 0 are common, 3 are distinctive, and 1 is very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈3
Distinctive · estimate
This author's own choices. Worth a look.
1
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 15
Every other skill here records a seal over its own measurements and then checks that seal against itself.
- Distinctive: line 45
all five sibling ledgers still reproduce their own pinned values on both sides of that boundary, which is the actual reason one pin can …
- Distinctive: line 87
No network import reaches this skill, and none of the banned roots appears.
- Very specific: line 92
Every number in a claim sentence is bound to a pinned value elsewhere in the ledger set.
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
REPRODUCIBILITY — which interpreter class produced this shard
Every other skill here records a seal over its own measurements and then checks that seal against itself. That proves nobody edited the numbers after they were written. It says nothing about whether the numbers are the same numbers on a different Python.
This one asks the other question, and it is the reason the claim "byte-identical across
the whole matrix" had to be corrected rather than trusted. It turns out to be false for
exactly one instrument, and the reason is a change in CPython's sum().
Run the gate
python3 skills/reproducibility/scripts/elohim_run.py| flag | effect |
--json | machine-readable payload |
--discover | propose unpromoted measurements into backlog.json |
--list-backlog | print what is waiting, and exit |
--max-seconds N | child budget, default 600; a timeout is a reported verdict, not a wall of stderr |
What it measures
Running this instrument runs each of the five sibling instruments, reads back the seal each one recorded, and classifies it. The measured result:
- four instruments produce a byte-identical shard on every interpreter in the range
- one instrument,
estimator-bias, splits into exactly two classes at CPython 3.12 - the boundary is 3.12 because
sum()became Neumaier compensated summation there:sum([0.1] * 10)is0.9999999999999999on 3.10 and 3.11 and1.0on 3.12 and later - all five sibling ledgers still reproduce their own pinned values on both sides of that boundary, which is the actual reason one pin can serve two classes
The five gates
1. the checksum pin
This skill's own cross_version.py is pinned by sha256 and byte count in
ledger.json. The sibling pins are checked too, and a sibling pin is compared against
that sibling's own ledger rather than against a digest copied into this skill.
2. the fact ledger
Six facts, all counts, all interpreter-independent, bound to the fresh shard. The pinned values are 5, 5, 5, 5, 2 and 1: five siblings answer, five seals are in a pinned class, five pins hold, five ledgers reproduce, no instrument is pinned to more than two classes, and exactly one instrument's shard moves.
No floating point appears in the shard. A float measured here would vary with the
interpreter for reasons the shard has no business recording, so a rounding difference
could change this skill's own seal. The residuals are real, the largest is 2.220e-16, and
they are printed on stdout and measured across the whole matrix by tools/matrix.py
rather than pinned. Wall-clock gets the same treatment, for the same reason: it is
measured and reported, never a number someone has to defend.
This skill's own seal is not the same on every interpreter, and it should not be —
diffing 3.10.20, 3.12.13 and 3.14.5 shows the only fields that move are
interpreter.version, interpreter.class, each skill's class and observed_under,
and, for estimator-bias alone, its seal12. Those are the facts the shard exists to
record. What the no-float rule buys is that nothing else can move it, and the
no_float_reached_the_shard trap makes that mechanical rather than a promise.
3. independent trap re-derivations
Seven traps, none of which reads a boolean the instrument wrote. every_observed_seal_is_pinned
is the tripwire: an observed seal matching no pinned class names the instrument and the
seal and turns the gate red. no_float_reached_the_shard guards the design decision in
gate 2. references/traps.md has the rest, including a bytecode-cache hazard that made
an earlier version of the suite report a failure about a file that was already restored.
4. source hygiene
No network import reaches this skill, and none of the banned roots appears. Every tool in this repository is standard library only.
5. claim binding
Every number in a claim sentence is bound to a pinned value elsewhere in the ledger
set. No hex digest appears in a claim: a digest reads as an integer to the binder, so
5f12cc7825b5 would be checked as the number 512.
Promote deliberately
--discover re-derives four measurements from the siblings and writes them to
backlog.json. They are not pins. A measurement becomes a fact when someone reads it,
decides it is worth being wrong about, and adds it to ledger.json by hand.
Files
| path | what |
instrument/cross_version.py | runs the siblings, reads their recorded seals, classifies them |
scripts/elohim_run.py | the gate entry point, shared byte-for-byte across skills |
scripts/check_traps.py | the seven re-derivations |
scripts/discover.py | unpromoted measurements, re-derived from scratch |
references/traps.md | the class table, the full digests, and why each trap exists |
references/seal-independence.md | which traps a forger cannot fool, and which 77 % of tampers only the checksum catches |
ledger.json | the six pinned counts |
backlog.json | what has been measured and not yet promoted |
../elohim-harness/ | the harness that runs all of this |
../../tools/matrix.py | the same classification across every interpreter on the machine |
../../tools/seal_independence.py | the seal-independence sweep, re-derives the census above |
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

