orchestrator-judgment
Skill0 starsChanged 4 months agoMITView on GitHub
Use when dispatching subagents for search, investigation, or implementation — draws the line between what can be delegated and what the orchestrator must decide itself, and requires checking causal claims that come back in subagent reports
In this repository7 other files it gives its agents.
- agent-memorySkill
- blast-radiusSkill
- falsifier-designSkill
- ratchet-not-ceilingSkill
- root-cause-disciplineSkill
- standing-instructionsSkill
- verify-before-judgingSkill
The file
We split this skill into the rules it gives an agent
2 rules. About 0 are common, 2 are distinctive, and 0 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈2
Distinctive · estimate
This author's own choices. Worth a look.
0
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 36
Do not accept and proceed.
- Distinctive: line 80
When capacity frees up, the default should not be "start the next task." It should be "attack the thing I just decided."
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
The orchestrator owns judgment
Subagents are eyes and hands. The brain stays in one place.
The line
Delegate: searching, measuring, implementing, reproducing, retroactive verification, adversarial checking. Anything with a bounded question and a checkable answer.
Never delegate: the conclusion. Priority. What goes in this batch. What gets rejected. Scope. Whether a trade is worth making.
Why the line is exactly there
A subagent sees only inside its own task. That is the point — it's how they stay cheap and focused. But it means they are structurally incapable of seeing:
- Seams — where their piece meets someone else's
- Duplication — that another agent is solving the same thing
- Omissions — what nobody was asked to look at
Those three are where the real defects live. Only the orchestrator has the vantage.
I once delegated the synthesis step of a replanning task — the part where findings become a plan. That's the one step that requires seeing all of them at once. It came back locally sound and globally wrong.
When a report comes back
Do not accept and proceed. Run five things:
- Recompute the trade. The subagent optimized its own task. You own the cost/benefit across all of them.
- Redraw the scope. New facts change what should be in this batch. Re-decide; don't inherit.
- Cross-check against other tracks. Does this contradict what another agent reported? Contradictions are the highest-value signal you get.
- Ask what they didn't do. Explicitly. "Unverified" sections are where the risk is, and they're easy to skim past.
- Check every causal claim. ← the one people skip.
Recheck the causality yourself
A subagent reported that a flag I enabled was causing a metric regression. The mechanism it described was real. The timing made it impossible — the regression had started 34 hours before the flag was switched on. The agent had even noted "causal ordering not verified" in its own caveats section.
A causal link handed to you in a report gets the same scrutiny as one you formed yourself. Delegation moves the work, not the responsibility.
Writing a brief
The brief is where orchestrator judgment gets encoded. Include:
- Confirmed facts, separated from open questions
- Explicit out-of-scope list — and why, because the reason may expire
- The success criterion — which single result decides whether this worked
- What must NOT change, with a contract test naming it
- "Report, don't act" for anything that would exceed scope
- A demand for honesty: "if you couldn't verify it, write 'unverified' — do not present an estimate as a measurement"
For adversarial checks, state the stance explicitly: "your job is to break this conclusion, not to confirm it — when uncertain, rule against it." Without that, you get agreement.
Spend spare capacity on your own conclusions
In one working day I dispatched five subagents. Zero of them were tasked with attacking my conclusions — all five were gathering. Both of my errors that day were caught incidentally, by investigations aimed at something else.
When capacity frees up, the default should not be "start the next task." It should be "attack the thing I just decided."
Related
falsifier-design— the specific conclusion most worth attackingstanding-instructions— what the orchestrator must check regardless of reports
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

