assess-idea
Skill7 starsChanged 3 months agoMITView on GitHub
Pressure-test a research idea before committing: a-priori bound, the crux, the cheapest de-risking check; go / no-go / de-risk-first.
In this repository25 other files it gives its agents.
- assumption-auditSkill
- attribute-mechanismSkill
- campaign-reviewSkill
- campaign-statusSkill
- cite-checkSkill
- claim-auditSkill
- correctness-suiteSkill
- debugSkill
- deriveSkill
- dimensional-analysisSkill
- discovery-loopSkill
- experiment-designSkill
- fork-campaignSkill
- frame-problemSkill
- handoffSkill
- improve-kitSkill
- literature-reviewSkill
- model-selectionSkill
- new-campaignSkill
- new-projectSkill
- record-decisionSkill
- reportSkill
- run-campaignSkill
- simulation-designSkill
- verifySkill
The file
We split this skill into the rules it gives an agent
3 rules. About 0 are common, 0 are distinctive, and 3 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈0
Distinctive · estimate
This author's own choices. Worth a look.
3
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Very specific: line 25
frame-problem: instead once the idea is a go. - Very specific: line 28
verify: instead when there is already a result to check. - Very specific: line 68
When invoked inside a running or forming campaign, or by new-campaign as a pre-scaffold check, assess-idea is advisory.
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
assess-idea — pressure-test the idea before you commit
Most wasted research effort is committed at the start, on a problem chosen because it sounded interesting
rather than checked for solvability or worth. This skill is the triage for that moment, and the counterpart
to verify: where verify treats a result as wrong until independently proven right, assess-idea treats
an idea as not worth doing until its case is made. Truth over excitement applies to idea selection: a
well-evidenced "this cannot clear the ceiling" or "this is already solved" is a successful assessment.
Novelty and rigor are compatible: unconventional and ambitious ideas are in scope, and this skill is not a filter against them. The job is to find the cheapest path to the truth about whether the idea works, and to name the one thing most likely to sink it. Attempt to falsify the idea as hard as the case for it was built; an idea that survives is pursued without reservation.
When to use / not use
- Use on a raw idea or direction, before investing: "what do you think of this?", "is this worth it?",
"is this feasible?", "should we work on X?". Also an optional advisory pre-check before
new-campaignscaffolds a loop around an unvetted idea. frame-probleminstead once the idea is ago. That skill plans how to do a problem already decided on: physics inventory, verification plan, decomposition.assess-ideais upstream of it and lighter; it decides whether to do the work at all. Hand off toframe-problemon ago.verifyinstead when there is already a result to check.new-campaignto scaffold a decided loop.- Collaboration first. Problem selection is a shared decision: surface the assessment and its reasoning and let the researcher choose. Do not unilaterally kill or greenlight someone's idea. The verdict is a recommendation with its evidence, not a verdict on the researcher.
The assessment
Work these in order. Stop early on a decisive result: a hard physical no in step 2 ends it. Keep the effort proportional — a quick idea gets a quick pass, a large commitment the full battery.
- Restate the idea and what success would look like. In your own words: the claim or goal, and the concrete criterion by which it would count as working. If the idea is fuzzy, or intent is being filled in, clarify with the user first. A moving target cannot be assessed.
- Bound it a priori (compose
dimensional-analysis, or a lightframe-problempass). Compute the ceiling, floor, and order of magnitude: is the hoped-for effect physically available at all? An idea that cannot clear a known threshold, or that needs a quantity to exceed a hard bound, is a fast, well-evidenced NO-GO. State the number. - Locate the crux. Name the single hardest or most-uncertain part, the thing most likely to sink the idea: a required assumption, an unproven mechanism, a measurement at the edge of feasibility. Name the cheapest check that would de-risk it, the killer experiment, static probe, or back-of-envelope that, done first, settles the biggest doubt. This is usually the highest-value output of the assessment.
- Prior art & analogy (compose
literature-review, or a quick targeted search). Has this been tried, and if it was abandoned, why? What is the closest solved problem, and does its approach transfer? Cite real sources, and runcite-checkon anything load-bearing. "I don't recall seeing it" is not evidence that an idea is novel. - Weigh worth. Payoff if it works (the capability, decision, or new prediction it would enable) × tractability × cost / risk / time. Is there a cheaper decisive experiment that should come first? Weigh compute and effort, not coding time, which is routinely mis-estimated. A high-payoff long shot with a cheap de-risking check can beat a safe, low-value grind.
- Alternatives & push-back. Is there a stronger version of the idea, or a simpler route to the same goal? Offer it. The best assessment is sometimes "yes, but do this adjacent thing instead."
- Verdict — grade it, with the premise exposed. Return one of:
- GO — plausibly solvable and worth it; the crux is acceptable. Hand to
frame-problem. - DE-RISK-FIRST — promising, but gated on the crux: do the cheap check from step 3 before committing. This is the most common honest verdict.
- NO-GO — not worth it as posed: it cannot clear the ceiling, the crux is a wall, it is already solved, or a cheaper alternative dominates. Say so plainly, with the evidence. State the verdict's confidence and the load-bearing assumptions it rests on (an assumed parameter, a feasibility estimate). A different assumption may flip the verdict, so the user sees the hinge.
- GO — plausibly solvable and worth it; the crux is acceptable. Hand to
In a campaign — advisory only
When invoked inside a running or forming campaign, or by new-campaign as a pre-scaffold check,
assess-idea is advisory. It records its verdict as a record-decision entry with a revisit-if trigger,
and it never blocks scaffolding or a run. The human decides; the skill informs. Problem selection stays
collaborative even when the loop is otherwise autonomous.
Output
A short, structured take. The headline is the crux and the cheapest de-risking check. Then the a-priori
bound, the worth weighing, any stronger alternative, and the graded verdict with its confidence and
assumptions. Standalone: a message. In a campaign: a record-decision entry.
Composition
dimensional-analysis— the a-priori bound (step 2), the cheapest correctness and feasibility filter.frame-problem— the hand-off on aGO; it plans the how,assess-ideadecides the whether.literature-review/ a targeted search +cite-check— prior art and analogy (step 4).verify— when a factual claim underlies the idea, check that claim before trusting the case for it.record-decision— log the verdict and its revisit-if trigger (campaign/advisory mode).new-campaign— may compose this as an optional advisory pre-check before scaffolding.
The failure mode to guard against
Motivated optimism: the pull to encourage an idea because it is the user's, or because it might work.
Guard it as verify guards against treating convergence as correctness. Make the case against the idea
explicitly, name the crux, and give the number. An encouraging answer that skips step 2 is the failure this
skill replaces.
Checklist
- The idea and a concrete success criterion are restated (clarified with the user if fuzzy).
- Bounded a priori: the ceiling/floor/order is a number, and physical availability is checked.
- The crux (hardest or most-uncertain part) is named, with the cheapest check that would de-risk it.
- Prior art / closest solved problem considered; load-bearing claims cited (
cite-check). - Worth weighed (payoff × tractability × cost/risk); a cheaper decisive test surfaced if one exists.
- A stronger or simpler alternative offered where there is one.
- A graded verdict (GO / DE-RISK-FIRST / NO-GO) with confidence and load-bearing assumptions stated.
- In a campaign: recorded as advisory (
record-decision), not a block.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

