agentleFS
fatih-developerfatih-developer/fth-skills/skills/multi-brain-score/SKILL.md

multi-brain-score

Skill7 starsChanged 43 days agoMITView on GitHub

Confidence-scoring overlay for multi-brain: each perspective rates its confidence 1-10 with a reason, consensus is weighted by those scores, and low-confidence areas are flagged. Use when the user wants to know how certain a recommendation is, or when uncertainty should be explicit in a decision.

The file

We split this skill into the rules it gives an agent

6 rules. About 0 are common, 6 are distinctive, and 0 are very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈6

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 0

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Add quantified confidence scoring to any multi-brain decision.

    line 8
  2. Distinctive:

    Before consensus, analyze the confidence landscape:

    line 48
  3. Distinctive:

    Use confidence scores to weight the consensus:

    line 68
  4. Distinctive:

    Medium confidence (5-7): Consider as a modifier or secondary input.

    line 71
  5. Distinctive:

    If any perspective scores below 5, or if the spread between scores is > 4:

    line 88
  6. Distinctive:

    If all scores are below 5, recommend more research before deciding instead of forcing a weak consensus.

    line 119

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Multi-Brain Score Protocol

Add quantified confidence scoring to any multi-brain decision. Each perspective rates its own confidence, and the consensus uses scores as decision weights. Uncertainty becomes visible instead of hidden.


Workflow

1. Run base multi-brain (3 perspectives)
2. Each instance scores its confidence (1-10)
3. Weighted consensus based on scores
4. Flag uncertainty zones
5. Produce full output with scores visible

Step 1: Perspectives with Scores

Each instance provides their perspective plus a confidence score:

## 🧠 Brainstorm (Scored)

**Instance A — Creative:** (Confidence: 6/10)
[2-3 sentences]
_Confidence rationale: Novel approach but limited precedent in production._

**Instance B — Pragmatic:** (Confidence: 9/10)
[2-3 sentences]
_Confidence rationale: Well-established pattern, used this successfully before._

**Instance C — Comprehensive:** (Confidence: 7/10)
[2-3 sentences]
_Confidence rationale: Good coverage of risks but missing data on edge case X._

Step 2: Score Analysis

Before consensus, analyze the confidence landscape:

## 📊 Confidence Analysis

| Instance | Score | Strength | Weakness |
|----------|-------|----------|----------|
| A — Creative | 6/10 | High potential impact | Unproven approach |
| B — Pragmatic | 9/10 | Battle-tested | May miss innovation |
| C — Comprehensive | 7/10 | Risk-aware | Incomplete data |

**Average Confidence:** 7.3/10
**Spread:** 3 points (moderate disagreement)
**Highest Confidence:** Instance B

Step 3: Weighted Consensus

Use confidence scores to weight the consensus:

  • High confidence (8-10): This perspective's core recommendation carries heavy weight.
  • Medium confidence (5-7): Consider as a modifier or secondary input.
  • Low confidence (1-4): Flag as an area needing more research before deciding. Do not ignore — surface it as a risk.
## ⚖️ Weighted Consensus

**Primary direction:** [Based on highest-confidence perspective]
**Modified by:** [Elements from medium-confidence perspectives]
**Flagged for research:** [Low-confidence areas that need validation]

**Overall Decision Confidence:** [Weighted average]/10

Step 4: Uncertainty Flags

If any perspective scores below 5, or if the spread between scores is > 4:

> ⚠️ **Uncertainty Alert:** [Description of what is uncertain and what would resolve it]

Step 5: Full Output

Mandatory: The final response must include all scored perspectives, the confidence analysis table, the weighted consensus, any uncertainty flags, and the complete deliverable.


Scoring Rubric

ScoreMeaningWhen to Use
9-10Near-certainStrong evidence, proven pattern, minimal unknowns
7-8ConfidentGood reasoning, some minor unknowns
5-6ModerateReasonable approach but notable gaps
3-4LowSpeculative, lacks supporting evidence
1-2GuessNo solid basis, flagging for transparency

Guardrails

  • Always show scores inline with perspectives — they are part of the deliverable.
  • Confidence rationale is mandatory — a bare number without explanation is useless.
  • Never inflate scores — honest uncertainty is more valuable than false confidence.
  • If all scores are below 5, recommend more research before deciding instead of forcing a weak consensus.
  • Scores should create action items — low scores become "things to validate."
  • This protocol can be combined with base multi-brain or multi-brain-experts.

References

  • See references/EXAMPLES.md for scored decision examples.

🔗 Next Steps & Handoffs

<!-- BEGIN GENERATED: handoffs (generated from the ecosystem workflow map by build_ecosystems.py — do not edit by hand) -->

Ecosystem: @ecosystem-reasoning — Reasoning, Planning Gates & Prompting.

Workflows:

  • Decision Quality Flow (reason-decision, step 4 of 5): next → @output-critic (optional).

Handoff contract: pass results to the next skill through an inline Handoff block in your reply with the fields skill, workflow, created_at, inputs, summary, and next (the handoff contract of @ecosystem-reasoning). If a next skill is not installed, continue with its step from the ecosystem map, or install it with npx skills add fatih-developer/fth-skills --skill <name> after the user agrees.

<!-- END GENERATED: handoffs -->

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.