agentleFS
acprkacprk/crypto-research-agents/skills/rebuttal/SKILL.md

rebuttal

Skill15 starsChanged 10 days agoMITView on GitHub

Use when reviews arrive and an author response (rebuttal / interactive phase / revision response) must be produced. Covers timeline, triage of reviewer points into must-answer / clarify / ignore, word-budget packing, evidence-first answers, new-experiment policy, tone, and the two-document structure (short submitted version + detailed per-reviewer internal version).

14 other projects use a version of this.

Adopted by

Most recently taken up by

Used with

Projects with it also use daily-arxiv, exp-eval and 10 more.

Other files people use alongside this one.

Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
  • LambenthanSkill

    daily-arxiv

    每日从 arXiv 拉取新论文,过滤相关性,auto-ingest 高优先级论文,检测 SOTA 更新

    Also in 5 projects that use this

  • LambenthanSkill

    exp-eval

    实验判决门:Review LLM 独立评判实验结果 → 4 种判决路径 → 自动更新 claims confidence、ideas status、graph edges

    Also in 5 projects that use this

  • skyllwtSkill

    exp-pilot-eval

    Pilot result evaluation — read pilot results, apply success criteria, update idea page (pilot_result, failure_reason if failed), generate PILOT_VERDICT_REPORT. Called by /ideate Phase 5 after /exp-pilot-run.

    Also in 4 projects that use this

  • skyllwtSkill

    exp-pilot-run

    Pilot experiment execution — read Pilot Spec YAML, write pilot code, run experiment(Confirm with the user before operation and require the applicant to conduct manual inspection), return results. Called by /ideate Phase 5. Does NOT modify wiki pages or judge pass/fail.

    Also in 4 projects that use this

  • phanghonghaoSkill

    poster

    HTML/CSS A4 海报生成。从沙龙/活动 Markdown 文件生成科技风 A4 海报 PDF/PNG。Use when user mentions: poster, 海报, 海报生成, make poster, generate poster, 活动海报, 沙龙海报.

    Also in 4 projects that use this

  • +6 more from Lambenthan
  • +1 more from skyllwt

The file

We split this skill into the rules it gives an agent

6 rules. 0 are common, 5 are distinctive, and 1 is very specific to this project.

  • 0

    Common

    Most of the 12 edited versions we read keep these.

  • 5

    Distinctive

    This author's own choices. Worth a look.

  • 1

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    If an attack or issue affects the baseline equally, measure both side by side and give a fix that applies to both.

    line 55
  2. Distinctive:

    Write the detailed version first (unbounded).

    line 67
  3. Distinctive:

    Remove all adjectives, all "we believe", all restatements longer than one line.

    line 74
  4. Very specific:

    Run only experiments that answer a must-answer point and can finish, be verified and be logged within the window.

    line 81
  5. Distinctive:

    If a result contradicts an earlier number, report the new one and retract the old.

    line 85
  6. Distinctive:

    Do not introduce new claims that were not in the submission unless answering a question.

    line 88

“Common” is measured: kept by at least 6 in 10 of the 12 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Rebuttal

Templates: templates/rebuttal/{timeline.md, triage_table.md, rebuttal_short.md, rebuttal_detailed.md}. Never commit real reviews to a shared repository; keep them in the private project only.

1. Timeline (typical 5–7 day window; adapt with timeline.md)

daywork
D0Read all reviews twice, no replies. Copy each review verbatim into the private project. Split into atomic points with ids (R1.1, R1.2, ...).
D0–D1Triage table. Identify the decisive reviewer (the most negative with the highest confidence) and the potential champion. Decide which new experiments are feasible within the window.
D1–D3Run experiments/verification (bench protocol from experimenter; interleaved runs; new EVIDENCE rows). Draft the detailed internal version per reviewer.
D3–D4Compress to the short version within the word/character budget. Falsifier + reviewer-sim pass on the draft ("does this answer the question asked?").
D4Human author final review; submit early (systems get slow near deadlines; convert the deadline to your timezone).
afterInteractive phase: answer follow-up questions within the window; same evidence-first rules. Record everything in DECISIONS.md.

2. Triage

For each atomic point decide:

classmeaningaction
must-answerwould change the decision: correctness doubt, counterexample, fairness of comparison, missing baseline, security level, novelty vs a named paperfull evidence-first answer in the short version
clarifymisunderstanding or missing detail answerable in 1–2 sentencesone sentence in the short version or grouped
concede-and-fixthe reviewer is right about an error or overclaimadmit plainly, state the corrected statement, show the fix does not affect (or how it affects) the main results
promiseeditorial / typos / notation / bibone grouped line: "All editorial points will be fixed."
ignoreout of scope, factually wrong but harmless, tasteno space in short version; answer in detailed version only if cheap

Priority: decisive reviewer's must-answer points first, then points raised by more than one reviewer (answer once, cite all reviewer ids), then the champion's questions (give them ammunition for the discussion).

3. Answer shape (evidence first)

[R2.1] <restated question in ≤ 1 line>
Answer first (yes/no/number) → evidence (table, theorem, log, measured number with
scope) → what changes in the paper (section/page) → optional one-line consequence.
  • Lead with the answer, not with thanks or background.
  • Numbers come from new or existing EVIDENCE rows; say how they were measured (same session, interleaved, n runs, median).
  • Where a counterexample is correct, say so in the first sentence and give the fixed statement; do not argue around it.
  • Turn challenges into content: a fairness complaint becomes a new comparison table; a security question becomes a security section; "why not compare with [X]" becomes "they compose: measured composition = ..." or "the regimes do not overlap: ...".
  • If an attack or issue affects the baseline equally, measure both side by side and give a fix that applies to both.
  • Retract unsupported numbers proactively, in the same message as the corrected version. Retracting beats being caught.
  • Direct verification with authors of a cited work (e.g. confirming scope of their attack) is strong evidence; mention it factually.

4. Word-budget packing

Typical budgets: a few hundred to ~1000 words or a character cap; some systems accept only plain text. Check the review system's limit on day 0.

  1. Write the detailed version first (unbounded).
  2. Short version (500–700 words is a good target when the cap is ~750–1000):
    • One opening line: "We thank the reviewers. Page numbers refer to the revised version [if allowed]; all editorial points will be fixed."
    • Grouped headings by issue, tagged with reviewer ids, ordered by decision impact: **Comparison fairness (R2, R3).**.
    • Max 1 compact table (plain text if the system strips formatting).
    • Remove all adjectives, all "we believe", all restatements longer than one line.
    • Merge answers shared by reviewers.
  3. Count words with the system's counting rule (e.g. wc -w on the plain text) and leave 5% margin.

5. New-experiment policy

  • Run only experiments that answer a must-answer point and can finish, be verified and be logged within the window. Pre-register what would count as success in DECISIONS.md before running.
  • Same bench protocol as the paper (interleaved, same machine, verified outputs).
  • If a result contradicts an earlier number, report the new one and retract the old.
  • Venue rules differ on whether revised PDFs/supplements may be uploaded during rebuttal; if not allowed, describe the change and promise it.
  • Do not introduce new claims that were not in the submission unless answering a question; reviewers may treat them as a different paper.

6. Tone

Neutral, factual, brief. Agree when right. Never "the reviewer misunderstood"; write "We will clarify: ...". No appeals to authority, no complaints about the review process, no emotional language. Address the meta-reviewer's questions explicitly by their numbering.

7. After the decision

  • Accepted: build a request → where answered map (CHANGES.md: reviewer point → section/page in the final version) and feed it to camera-ready.
  • Rejected: convert the triage table into a revision plan for the next venue; keep the evidence rows; lessons into DECISIONS.md.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.