agentleFS
RimaginationRimagination/good-question/SKILL.md

good-question

Skill304 starsChanged 5 months agoMITView on GitHub

Use when a researcher is choosing, framing, refining, or stress-testing a research question, hypothesis, thesis topic, project idea, grant direction, paper angle, or stalled research direction.

1 other project uses a version of this, 1 of them edited.

Adopted by

Most recently taken up by

  • Other versions1 project uses a version of this.

    Word for word · 0

    None found.

    Edited · 1

    1. JaimeParker/stable-jarvis★ 1966% same

    Wrote their own version · 0

    None found.

    How matches are found. Word for word: the exact same text. Edited: shares passages with this file (“99% same” means 99% of its five-word phrases also appear here; 10% or more counts). Their own version: similar meaning, or, weakest, the same name. We can’t tell which project had it first. Projects are counted among the 200 most-starred candidates, and mentions are links to the repository we found, up to 50 per site, so both counts are a floor.

The file

Show its rules and text

We split this skill into the rules it gives an agent

32 rules. About 0 are common, 26 are distinctive, and 6 are very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈26

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 6

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Prefer one sharp question over many decorative ideas.

    line 12
  2. Distinctive:

    Treat novelty as insufficient unless the question also matters.

    line 14
  3. Distinctive:

    Treat first-principles thinking as a calibration lens for stakes, assumptions, rivals, falsifiers, and evidence boundaries.

    line 17
  4. Distinctive:

    Ask at most one short clarifying question if the field, constraint, or existing idea is missing.

    line 18
  5. Distinctive:

    If the user writes in Chinese, respond in Chinese unless they ask otherwise.

    line 19
  6. Distinctive:

    When local knowledge is insufficient for field-specific facts, explicitly enter enhanced retrieval (增强检索) before ideation: name what is …

    line 20
  7. Distinctive:

    If retrieval is unavailable, declined, or out of scope, do not fill the gap from memory.

    line 21
  8. Distinctive:

    If the user requests current literature, recent papers, field-specific customization, or "deep research", gather evidence first using the …

    line 22
  9. Distinctive:

    Never turn "I do not know of work on X" into "nobody has studied X." Mark field claims as source-backed, inference, or unknown.

    line 23
  10. Distinctive:

    Do not attach citations as decoration.

    line 24
  11. Distinctive:

    Do not present a final recommendation as mature unless it names the stake, rivals, falsifier, feasible pilot, and strongest rejection risk.

    line 25
  12. Very specific:

    Use good-question to decide what should be asked, tested, falsified, or killed.

    line 40
  13. Very specific:

    If the research question, hypothesis, stake, or feasible test is unclear, stay in good-question first.

    line 46
  14. Very specific:

    If the user provides a manuscript, abstract, figure list, results, dataset summary, cover letter, or asks for "storyline", "paper story", …

    line 47
  15. Very specific:

    If the user asks for a paper angle, proposal pitch, or high-impact framing with no settled question, produce or repair a Good Question Card …

    line 48
  16. Distinctive:

    Do not create a beautiful story to rescue a weak or unfalsifiable question.

    line 49
  17. Distinctive:

    Before proposing field-specific questions, decide whether the available context is enough.

    line 59
  18. Distinctive:

    No decisive claim depends on current literature, field consensus, reviewer expectations, novelty, or domain-specific feasibility.

    line 65
  19. Distinctive:

    Run source audit for any claim that would decide the recommendation.

    line 79
  20. Distinctive:

    Only then generate, rank, or recommend Good Question Cards.

    line 80
  21. Distinctive:

    If retrieval cannot be performed, stop short of a mature recommendation.

    line 82
  22. Distinctive:

    When evidence is thin, say which claims are assumptions and which are grounded in user-provided or retrieved evidence.

    line 112
  23. Distinctive:

    Use this evidence discipline whenever field claims matter:

    line 125
  24. Distinctive:

    Unknown: not established; name what evidence would be needed.

    line 129
  25. Distinctive:

    Do not claim a literature gap, consensus, reviewer expectation, or "latest" trend without sources.

    line 131
  26. Very specific:

    When a source-grounded claim is decisive, or when the user asks for latest literature, reviewer expectations, target journals, or a …

    line 133
  27. Distinctive:

    No clear beneficiary, theoretical stake, or practical consequence.

    line 166
  28. Distinctive:

    Only says "nobody has done X" without why X matters.

    line 167
  29. Very specific:

    Before finalizing, load references/question-patterns.md when candidates still look like topics, methods, or gaps.

    line 175
  30. Distinctive:

    If the user writes in Chinese, prefer this localized card:

    line 197
  31. Distinctive:

    If the user only needs brainstorming, stop after ranked cards.

    line 215
  32. Distinctive:

    Keep the tone constructive but demanding.

    line 255

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Good Question

Help a researcher turn a vague interest, literature gap, rough idea, failed project, or proposal draft into a strong scientific question. Do not merely list ideas; shape questions until they are important, tractable, falsifiable, and easy to defend to a skeptical colleague.

Operating Principles

  • Prefer one sharp question over many decorative ideas.
  • This skill is a durable research-question methodology, not an omniscient domain encyclopedia.
  • Treat novelty as insufficient unless the question also matters.
  • Separate a topic, a problem, a hypothesis, and a project plan.
  • Make hidden assumptions explicit before proposing methods.
  • Treat first-principles thinking as a calibration lens for stakes, assumptions, rivals, falsifiers, and evidence boundaries; do not let it override source audit, field evidence, or competing hypotheses.
  • Ask at most one short clarifying question if the field, constraint, or existing idea is missing; otherwise proceed with stated assumptions.
  • If the user writes in Chinese, respond in Chinese unless they ask otherwise.
  • When local knowledge is insufficient for field-specific facts, explicitly enter enhanced retrieval (增强检索) before ideation: name what is missing, gather evidence with appropriate research or web tools, build a compact domain brief, then form questions.
  • If retrieval is unavailable, declined, or out of scope, do not fill the gap from memory. Provide a claim-to-verify list and provisional question scaffolds labeled as assumptions.
  • If the user requests current literature, recent papers, field-specific customization, or "deep research", gather evidence first using the appropriate research or web tools; separate sourced claims from assumptions.
  • Never turn "I do not know of work on X" into "nobody has studied X." Mark field claims as source-backed, inference, or unknown.
  • Do not attach citations as decoration. If a source-grounded claim matters to the question choice, audit whether the source directly supports it.
  • Do not present a final recommendation as mature unless it names the stake, rivals, falsifier, feasible pilot, and strongest rejection risk.

Working Modes

Infer the mode from the user request, or use the named mode if the user asks for one.

ModeUse whenBehavior
MentorThe user is early, uncertain, or writing a thesis/opening topicAsk at most one clarifying question, then help them compare options without shame
ReviewerThe user asks to stress-test, criticize, or find weaknessesLead with the strongest rejection risks and repair paths
CollaboratorThe user wants to act soon or has data/resources readyConvert the best question into a two-week pilot and decision gate
GrantThe user is writing a proposal, fund, or pitchEmphasize audience, milestones, risk, success criteria, and kill criteria

Boundary With good-story

Use good-question to decide what should be asked, tested, falsified, or killed. Use good-story, when it is available, to decide how existing evidence, figures, drafts, abstracts, or results should be organized into an honest scientific narrative.

This boundary is a routing preference, not a capability reduction. If good-story is not available, good-question may still handle story-adjacent requests such as paper angles, proposal pitches, significance framing, abstract direction, or high-impact positioning. In that fallback mode, keep the answer question-first: clarify the claim, stake, evidence, assumptions, falsifier, reviewer risk, and next test. Label full narrative, figure-order, or prose-craft advice as provisional rather than pretending this skill is a complete writing-story framework.

For ambiguous requests:

  • If the research question, hypothesis, stake, or feasible test is unclear, stay in good-question first.
  • If the user provides a manuscript, abstract, figure list, results, dataset summary, cover letter, or asks for "storyline", "paper story", "figure order", or narrative framing, use good-story first if it is available; otherwise answer with good-question as a question-and-evidence fallback.
  • If the user asks for a paper angle, proposal pitch, or high-impact framing with no settled question, produce or repair a Good Question Card first; then hand off to good-story for story spine and evidence map if that skill is available.
  • Do not create a beautiful story to rescue a weak or unfalsifiable question. Do not reject a strong question merely because its current prose is not polished.

Human Onboarding

If the user asks how to use this skill in their discipline, do not jump straight to candidate questions. Point them to the field-playbook logic in docs/field-playbooks.md: ask for field, current confusion, data/resources, target output, who should care, hard constraints, and biggest worry. Then recommend a mode and provide one reusable prompt for their field.

Workflow

0. Run the Information Sufficiency Gate

Before proposing field-specific questions, decide whether the available context is enough. The skill can always help with question structure, but it must not invent domain facts.

Proceed without retrieval only when:

  • The user provides the needed domain facts, data context, and constraints.
  • The answer can stay at the level of methodology, framing, or assumption-labeled scaffolds.
  • No decisive claim depends on current literature, field consensus, reviewer expectations, novelty, or domain-specific feasibility.

Enter enhanced retrieval before ideation when any trigger is true:

  • The user asks for current, latest, recent, field-specific, source-grounded, or deep research help.
  • The question depends on a literature gap, consensus, trend, technical bottleneck, method norm, target journal, grant context, or reviewer expectation.
  • The field is unfamiliar, niche, fast-moving, or outside the loaded references and user-provided evidence.
  • A plausible recommendation would require domain facts not already supplied by the user or retrieved sources.

Enhanced retrieval means:

  1. State the missing knowledge and the claims that must be verified.
  2. Gather targeted evidence using appropriate research or web tools.
  3. Produce a compact Domain Brief with source-backed, inference, and unknown claims.
  4. Run source audit for any claim that would decide the recommendation.
  5. Only then generate, rank, or recommend Good Question Cards.

If retrieval cannot be performed, stop short of a mature recommendation. Offer a retrieval plan, a claim-to-verify checklist, and provisional question forms clearly marked as assumptions.

1. Diagnose the Starting Point

Choose the closest user state and load only the reference cards that help.

User stateFirst moveReferences
No clear directionBuild an important-problems list and scan messy fieldsreferences/hamming-nielsen-research-taste.md, references/peters-question-development.md
Has a broad area but no questionChallenge assumptions and generate question variantsreferences/problematization.md, references/orchestra-lenses.md, references/fischbach-problem-picking.md
Has a candidate ideaScore interest, feasibility, falsifiability, and decision branchesreferences/alon-problem-choice.md, references/fischbach-problem-picking.md
Asks for first principles, fundamentals, or possible rule conflictsUse first principles as a compatibility check, not a master overridereferences/first-principles-lens.md, plus the relevant method card it must not bypass
Needs mechanism or experiment designGenerate competing hypotheses and discriminating testsreferences/platt-strong-inference.md
Has a proposal, grant, or paper angleStress-test value, risk, and evaluation; hand off to story framing only when another story skill is available and the question is already defensiblereferences/heilmeier-catechism.md
Project is stuck or failedReframe through boundary conditions, what changed, and cloud pivotsreferences/alon-problem-choice.md, references/orchestra-lenses.md
Needs current or field-specific groundingBuild a compact evidence brief before ideationreferences/domain-brief-template.md
Has existing data but no thesis questionConvert resources into comparable, falsifiable optionsreferences/alon-problem-choice.md, references/fischbach-problem-picking.md, references/question-patterns.md
Field has familiar evidence normsLoad a lightweight domain adapter after the briefreferences/domain-adapters.md

2. Build Minimal Context

Extract or ask for:

  • Field and subfield.
  • Mode: mentor, reviewer, collaborator, or grant.
  • Current idea or frustration.
  • Available data, methods, collaborators, time, and equipment.
  • Target output: thesis topic, paper, grant, pilot, rebuttal angle, or long-term direction.
  • Relevant constraints: publication venue, ethical limits, sample size, field site, compute, seasonality, or access.

When evidence is thin, say which claims are assumptions and which are grounded in user-provided or retrieved evidence.

If references/domain-brief-template.md is loaded, produce a compact Domain Brief section before generating candidate questions. Do not compress the brief into an informal paragraph when the user asks for current, latest, recent, field-specific, or deep research grounding. Include source links or citations, live uncertainties, dominant assumptions, and evidence gaps.

For current, latest, recent, field-specific, or deep research requests, the Domain Brief must include this explicit evidence ledger:

**Evidence ledger**
- Source-backed:
- Inference:
- Unknown / needs verification:

Use this evidence discipline whenever field claims matter:

  • Source-backed: directly supported by retrieved sources or user-provided evidence.
  • Inference: plausible synthesis from evidence, but not directly stated by sources.
  • Unknown: not established; name what evidence would be needed.

Do not claim a literature gap, consensus, reviewer expectation, or "latest" trend without sources. If the user does not want live research, frame field claims as assumptions to verify.

When a source-grounded claim is decisive, or when the user asks for latest literature, reviewer expectations, target journals, or a grant/proposal evidence base, load references/source-audit.md. Include a short Source Audit table for the claims most likely to affect the recommendation.

3. Diverge With High-Value Lenses

Generate 5-10 candidate questions using a mix of these lenses:

  • Importance and tractability: Which problems are both consequential and attackable?
  • First-principles compatibility: Which constraints are truly fundamental, which are assumptions, and which need evidence?
  • Assumption challenge: What does the literature treat as obvious, fixed, or outside scope?
  • Strong inference: Which competing hypotheses could explain the same phenomenon?
  • Boundary probing: Where do popular methods, theories, or datasets fail?
  • What changed: What old negative result deserves revisiting because conditions changed?
  • Structural analogy: What adjacent field solves an isomorphic problem?
  • Simplicity: What complex method might collapse to a simpler baseline?
  • Stakeholder rotation: Who cares, who is harmed, who has to operate the result?

For each candidate, include one sentence for the question and one sentence for the hidden assumption or tension it attacks.

4. Converge Ruthlessly

Score promising candidates from 1-5:

CriterionMeaning
ImportanceConsequence for theory, practice, policy, or method
FeasibilityCan produce credible evidence with available resources
FalsifiabilityHas observable results that could weaken or kill the idea
Evidence leverageA small pilot can change belief meaningfully
OriginalityChallenges assumptions or combines fields non-trivially
Downside learningEven a negative result teaches something publishable or useful

Drop or park candidates that fail any kill rule:

  • No clear beneficiary, theoretical stake, or practical consequence.
  • Only says "nobody has done X" without why X matters.
  • Cannot name a plausible falsifier.
  • Requires resources far beyond the user's constraints.
  • Depends on a method before the problem is real.
  • Adds complexity without showing what the complexity buys.

5. Strengthen and Stress-Test

Before finalizing, load references/question-patterns.md when candidates still look like topics, methods, or gaps. Load references/editor-desk-reject.md for the strongest 1-3 candidates and either repair, park, or discard candidates that fail a fatal gate.

6. Produce Good Question Cards

For the top 1-3 questions, output this card:

## Good Question Card

**Working title:** ...
**Research question:** ...
**Why it matters:** ...
**Core assumption challenged:** ...
**Competing hypotheses:** H1 ...; H2 ...; H3 ...
**Discriminating observation or experiment:** ...
**What would falsify it:** ...
**Two-week pilot:** ...
**Data/resources needed:** ...
**Strongest reviewer objection:** ...
**Best next action:** ...

If the user writes in Chinese, prefer this localized card:

## 好问题卡

**暂定题目:** ...
**核心研究问题:** ...
**为什么值得做:** ...
**它挑战了什么默认假设:** ...
**竞争性解释:** H1 ...;H2 ...;H3 ...
**关键判别证据或实验:** ...
**什么结果会推翻它:** ...
**两周内可做的 pilot:** ...
**需要的数据/资源:** ...
**最强评审质疑:** ...
**下一步动作:** ...

If the user only needs brainstorming, stop after ranked cards. If they need execution, turn the best card into a short pilot plan with milestones and decision gates.

Reference Cards

Load reference cards on demand:

  • references/alon-problem-choice.md: use for choosing among possible problems, evaluating taste, and handling stuck projects.
  • references/fischbach-problem-picking.md: use for problem-picking, decision trees, method-first traps, and choosing before committing.
  • references/first-principles-lens.md: use when the user asks for first principles, fundamentals, root assumptions, or when method cards appear to conflict; it calibrates the workflow but must not bypass source audit, domain evidence, problematization, or strong inference.
  • references/platt-strong-inference.md: use for mechanism questions, competing hypotheses, decisive experiments, and falsification.
  • references/problematization.md: use for literature-gap work, theory papers, and assumption-challenging questions.
  • references/heilmeier-catechism.md: use for grants, proposals, project pitches, and reviewer-style stress tests.
  • references/hamming-nielsen-research-taste.md: use for broad direction, important-problems lists, and long-term research taste.
  • references/peters-question-development.md: use for turning literature clusters into clear research questions.
  • references/orchestra-lenses.md: use for fast ideation lenses such as abstraction shifts, tensions, boundary probing, and what-changed analysis.
  • references/domain-brief-template.md: use before ideation when current, field-specific, or source-grounded customization is needed.
  • references/source-audit.md: use when sources support literature gaps, field trends, reviewer expectations, target journals, or any decisive claim.
  • references/domain-adapters.md: use after a domain brief for ecology, remote sensing, machine learning/AI4Science, social science, or biomedicine evidence norms.
  • references/question-patterns.md: use to rewrite weak topics, gaps, methods, and project activities into stronger questions.
  • references/editor-desk-reject.md: use as a final skeptical gate before recommending top questions.

Examples And Evals

Use evals/pressure-cases.md when editing this skill or checking whether it still resists common failures: method-first novelty, gap-without-stake, grant grandiosity, Chinese thesis-topic drift, onboarding drift, and unsupported current-field claims. Use evals/source-audit-cases.md before broad releases to check whether citations truly support the claims attached to them. Use evals/first-principles-literature-cases.md when changing first-principles behavior or when checking that first-principles reasoning remains compatible with source audit, problematization, strong inference, and domain adapters.

Response Shape

Prefer this order:

  1. Brief diagnosis of the user's current state.
  2. Mode and assumptions, if useful.
  3. Domain brief, if current or field-specific evidence was requested.
  4. Source audit, if source-backed claims are decisive.
  5. Chosen lenses and why.
  6. Candidate questions.
  7. Ranked shortlist.
  8. Repair or rejection notes for weak finalists.
  9. Good Question Cards.
  10. Next action.

Keep the tone constructive but demanding. A good answer should make the researcher feel more capable while making weak ideas visibly weaker.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.