agentleFS
anorthanorth/agent-skills/skills/arena/SKILL.md

arena

Skill1 starsChanged 11 days agoMITView on GitHub

Spawns N parallel candidates at the same task on different models, has a judge score them, picks a base, and grafts the strongest parts of the others into it. Use for /arena, "arena this", or when one attempt at a non-trivial artifact would lock in the wrong shape.

84 other projects use a version of this, 54 of them edited.

Adopted by

Most recently taken up by

Used with

Projects with it also use addskill, apply-firmware and 10 more.

Other files people use alongside this one.

Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
  • ryanportfolioSkill

    addskill

    Create, import, update, or install repo or personal skills: runtime ownership, resources, discovery checks.

    Also in 6 projects that use this

  • ryanportfolioSkill

    apply-firmware

    Bring current folder (plain folder, existing repo, old or partial firmware copy) up to full Harness Firmware in place. Mirror external repo → adopt-repo.

    Also in 6 projects that use this

  • +10 more from ryanportfolio

The file

We split this skill into the rules it gives an agent

11 rules. 0 are common, 10 are distinctive, and 1 is very specific to this project.

  • 0

    Common

    Most of the 83 edited versions we read keep these.

  • 10

    Distinctive

    This author's own choices. Worth a look.

  • 1

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Run the phases in order: Frame, Fan out, Cross-judge, Pick, Graft, Verify.

    line 14
  2. Distinctive:

    Every candidate gets the same prompt, so the prompt is the contract.

    line 18
  3. Distinctive:

    If a candidate produces no output, proceed with N-1 and note the dropout.

    line 41
  4. Very specific:

    After all Phase B candidates complete, spawn one read-only judge subagent on the strong tier.

    line 45
  5. Distinctive:

    Read every candidate end to end before picking.

    line 52
  6. Distinctive:

    When two feel tied, prefer the cleaner boundary or smaller API.

    line 58
  7. Distinctive:

    If the candidates converge on one shape, that is strong agreement.

    line 66
  8. Distinctive:

    No graft is needed. If they wildly diverge, Phase A was under-specified.

    line 67
  9. Distinctive:

    If they wildly diverge, Phase A was under-specified.

    line 68
  10. Distinctive:

    Verify the synthesized artifact like any other output: run its checks, if it has any, and score it against the rubric.

    line 72
  11. Distinctive:

    If verification finds a problem the arena missed, either Phase A was wrong (re-frame and re-run) or a candidate caught it and you missed …

    line 73

“Common” is measured: kept by at least 6 in 10 of the 83 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Arena

Run the phases in order: Frame, Fan out, Cross-judge, Pick, Graft, Verify.

Phase A: Frame

Every candidate gets the same prompt, so the prompt is the contract.

  1. State the artifact each candidate is producing.
  2. Derive the rubric, 3-6 concrete gradeable criteria for what success looks like on this task. It is the picker's tool in Phase D. Candidates only see the task.
  3. Pick the runners, on the strong tier through /model-tiers: by default two, each on a different model, taking the tier's available entries in order. Fall back to lower tiers if necessary to ensure distinct models. Spawn more runners when the arena covers multiple design directions.
  4. Give each candidate its own output location: a git worktree when candidates change the repo, otherwise /tmp/arena-<slug>/candidate-<n>/.

Phase B: Fan out

Spawn all N subagents at once, in the background where the harness allows, with this brief:

Read and follow <absolute path to this skill's directory>/runner.md.
Task: <the task>
Grounding: <paths to shared grounding, or "none">
Output: <this candidate's output location>

If a candidate produces no output, proceed with N-1 and note the dropout.

Phase C: Cross-judge

After all Phase B candidates complete, spawn one read-only judge subagent on the strong tier. Resolve it as a reviewer through /model-tiers: the judge runs on a different model from this session's. The judge sees the rubric and the candidates by path label, scores each criterion, and recommends a base with rationale. It runs in parallel with your reading in Phase D. Don't spawn it while candidates are still writing.

Phase D: Pick a base

Read every candidate end to end before picking. Score each against the rubric criterion by criterion, not on holistic feel, and compare with the cross-judge. Agreement on the base confirms the pick. Disagreement means one of you is biased or the rubric was ambiguous. Read both rationales before deciding.

Pick the base a future maintainer can extend most easily without breaking invariants. When two feel tied, prefer the cleaner boundary or smaller API.

Phase E: Graft

Walk each losing candidate once more for what is worth porting into the base, usually one or two things per candidate, not most of it. Fold each graft in by hand, so the result stays coherent under one mental model. Don't paste mechanically.

If the candidates converge on one shape, that is strong agreement. Note it and ship the consensus shape. No graft is needed. If they wildly diverge, Phase A was under-specified. Reframe and re-run rather than averaging the divergence.

Phase F: Verify

Verify the synthesized artifact like any other output: run its checks, if it has any, and score it against the rubric. If verification finds a problem the arena missed, either Phase A was wrong (re-frame and re-run) or a candidate caught it and you missed the graft (go back to Phase E). Don't paper over it.

Outputs

One synthesized artifact, with a short synthesis note alongside naming the base and why, the cross-judge's verdict, each graft with its source candidate, what was rejected and why, any convergence or dropouts, and the verification result.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.