agentleFS
brilliantroughbrilliantrough/agent-skills/skills/research/exp-discuss/SKILL.md

exp-discuss

Skill11 starsChanged 14 days agoMITView on GitHub

Talk a research idea through before planning or execution. Use when a researcher brings a fuzzy idea, hypothesis, or direction (我在想、你觉得这个方向) and wants to think together. Explore the question, assumptions and evidence, then identify the next step for the selected route — the project's reasoning/theory workflow, exp-workflow for evidence design, exp-campaign for a matrix, exp-batch for a bounded branch, exp-probe for one fact, or parking. Preserve meaningful route changes with save-mem; never design the experiment matrix or execute the research here.

The file

We split this skill into the rules it gives an agent

4 rules. About 0 are common, 2 are distinctive, and 2 are very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈2

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 2

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Very specific:

    Goal first: follow goal-first. Keep the researcher's actual question in view.

    line 17
  2. Very specific:

    Conversation first, no planning artifacts: No plan files, experiment matrices or commands.

    line 18
  3. Distinctive:

    Cheapest falsifier: if this idea is wrong, what is the smallest observation that would show it?

    line 30
  4. Distinctive:

    Do not let the discussion quietly become a plan or a running experiment.

    line 48

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Exp Discuss: listen → probe the idea → sharpen → route

This is the idea-only discussion layer of the experiment family. The researcher is thinking out loud; your job is a colleague with a long memory, not a planner. Nothing runs here, and nothing here becomes a plan document. exp-workflow coordinates the larger proxy-study → PyTorch readiness → full-model evaluation lifecycle.

When this skill applies

  • The idea is still fuzzy and the researcher wants to think together, not execute. An execution-ready experiment goes straight to exp-campaign / exp-batch / exp-probe; a non-experimental next step follows the project's research workflow.
  • The researcher's explicit choice wins; if the conversation drifts into design or running, name the skill it became and hand off per the routing table — never quietly do it here. Judge by how sharp the claim is, not by how long the experiments would run. Skill instructions are in English; deliverables follow the user's language (Chinese by default).

Posture

  • Goal first: follow goal-first. Keep the researcher's actual question in view; an interesting tangent is not a new assignment. Probe the uncertainty that could change the next decision, and stop discussing when the next action is clear.
  • Conversation first, no planning artifacts. No plan files, experiment matrices or commands. Use save-mem for meaningful route/hypothesis changes at handoff or parking, not every conversational turn; a promising idea must not disappear just because it was not parked.
  • Grill to stimulate, not to gate. Ask the frontier questions — the ones the conversation has already unblocked — each with your own take attached, and let a wrong take be corrected: that correction is usually where the idea sharpens. Do not demand completeness; a fuzzy half-answer is fine — note it and move on.
  • Rounds, not a quota. After each answer, recompute what it unblocked and ask the next round. There is no question cap, and "we have talked enough rounds" is not the stopping rule; the rule is that no further question would still change what the researcher wants to observe.
  • Bring evidence into the talk. Read project memory, past runs, logs, and dashboards so you can say "we already measured something adjacent" or "this assumption broke last time". Facts are yours to fetch; never quiz the researcher for what you could look up. When novelty or a literature claim matters, check the closest actual work and its limits; use research-evidence for targeted retrieval/reading, not a mandatory full review.

What to draw out

Work these threads as the conversation allows, in whatever order the idea suggests:

  1. The actual want: what would the researcher want to understand or establish — a pattern, explanation, derivation, counterexample or measured comparison? The question need not be a metric to beat.
  2. Why now: what existing result or anomaly triggered this idea? The motivation usually contains the real hypothesis.
  3. Hidden assumptions: what would have to be true for the idea to work? Name the ones the researcher has not said out loud (metric consistency, data leakage, seed variance, degenerate baselines, budget).
  4. Cheapest falsifier: if this idea is wrong, what is the smallest observation that would show it? Name a plausible competing explanation and what would distinguish it; do not treat an improved metric alone as proof of the proposed mechanism. This question often decides the route.
  5. Scope edge: what is explicitly NOT part of this idea? Vague scope now becomes a bloated campaign later.

Routing

Choose the next step for the selected research route, not the fate of every route — say which, and why:

StateRoute
Research question is clear, but the choice of proxy versus exploratory matrix or path to full-model evaluation is notexp-workflow — recommend an evidence route and its limits; co-design it rather than making the user invent it. A matrix can reveal the hypothesis or trade-off; a predicted winner is not required
Clear direction, multiple branches/ablations, conditional stagingexp-campaign — hand over the sharpened claim, axes, constraints, and the cheapest falsifier as the seed
One bounded branch, config mostly knownexp-batch — hand over the cells to fill and the acceptance metric
One missing fact or quick check blocks everythingexp-probe — hand over the single question and the minimal observation
The next step is derivation, literature analysis or finding a counterexample rather than an experimentProject research workflow — hand over the question, assumptions and existing evidence; do not force it into an experiment campaign
Idea needs to ripen, or evidence says "do not"Park it — use save-mem, not a plan file: idea, open questions, current evidence, pause reason and reopening condition; lack of evidence or resources is not falsification

Hard boundary

Do not let the discussion quietly become a plan or a running experiment. The moment the researcher wants commands, configs, or a matrix, that is the signal to hand off — this layer's job is done.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.