agentleFS
hidenobunagaihidenobunagai/astack/skills/interrogate/SKILL.md

interrogate

Skill1 starsChanged 11 days agoMITView on GitHub

Use for \"interrogate\", \"adversarial review\", \"multi-model review\", \"challenge this\", \"stress test this analysis\", \"find blind spots\", or \"tear this apart\". Several reviewers challenge a pipeline, notebook, metric, or analysis change from independent angles (result validity, code quality) and return a synthesized verdict.

73 other projects use a version of this, 16 of them edited.

Adopted by

Most recently taken up by

Used with

Projects with it also use ketchup-video, make-bot-ui and 3 more.

Other files people use alongside this one.

Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
  • tristanphvnSkill

    ketchup-video

    Catch the user up like /keel:ketchup, with a short silent video of slides for what happened and the waiting calls as text under it. Use for /keel:ketchup-video.

    Also in 14 projects that use this

  • eryzerzSkill

    make-bot-ui

    Use when building a custom UI (page, dashboard, buttons) that should wake a Grok Bot over a webhook, when the user must provide a webhook sender key, or when exposing that UI on Tailscale.

    Also in 20 projects that use this

  • bnemaSkill

    setup-pstack

    Configure which Pi models pstack uses per role. Detects available provider/model specs and writes pstack's user configuration. Use for /setup-pstack, "configure pstack models", or changing pstack model choices.

    Also in 25 projects that use this

  • ianclearySkill

    poteto-help

    Guides users through pstack setup, /poteto-mode, and picking the skill, playbook, or principle for a task. Type /poteto-help with a question.

    Also in 14 projects that use this

  • instructureSkill

    ketchup

    Rebuild context after /clear by analyzing uncommitted changes across Canvas LMS and all plugin repositories

    Also in 24 projects that use this

The file

We split this skill into the rules it gives an agent

4 rules. 0 are common, 3 are distinctive, and 1 is very specific to this project.

  • 0

    Common

    Most of the 73 edited versions we read keep these.

  • 3

    Distinctive

    This author's own choices. Worth a look.

  • 1

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    If the user names files, a notebook, or a diff, use that.

    line 18
  2. Distinctive:

    If the user's message refers to recent work, gather the relevant files.

    line 20
  3. Very specific:

    Before you spawn reviewers, state the intent in one paragraph.

    line 26
  4. Distinctive:

    Add reviewer C only when the change is high stakes, and reviewer D only when the work makes a statistical claim (a test, an effect …

    line 41

“Common” is measured: kept by at least 6 in 10 of the 73 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Interrogate

Spawn adversarial reviewers over a change to code, a notebook, or an analysis. The reviewers differ by lens and by model. The deliverable is a synthesized verdict. Do NOT auto-apply changes.

Panel note

This panel uses Claude models only, so vendor diversity is not available. Get diversity from the lenses and from mixing opus and sonnet. Each reviewer gets its own lens, so the reviews do not repeat each other.

Step 1, Scope

Identify what to review from the context:

  • If the user names files, a notebook, or a diff, use that.
  • Otherwise review the changes since the trunk: git diff $(git merge-base main HEAD) (it includes uncommitted edits), or name the commit range explicitly.
  • If the user's message refers to recent work, gather the relevant files.

Convert any notebook before you package it. Never package a raw .ipynb. Convert it to a script outside the repo with uvx jupytext --to py:percent --output /tmp/<name>.py <notebook>.ipynb, as described in the how skill. Include the data shape notes that the reviewers need: the input grain, the expected row counts, and the source tables.

Step 2, Intent

Before you spawn reviewers, state the intent in one paragraph. Use the user's message, the change descriptions, the PR description if one exists, and the code. If the intent is unclear, ask the user with AskUserQuestion before you go on.

Also state the decision the analysis serves, if there is one, and the number or result it must get right. Reviewers need this to judge whether an error matters.

Step 3, Spawn reviewers

Launch all reviewers in one message with the Agent tool. Use subagent_type Explore. The brief says "do not edit files, do not write to any warehouse, and do not run anything that changes a shared table or schedule".

ReviewerModelEffortLens emphasis
AopushighResult validity: grain, joins, filters, nulls, time windows, and whether the numbers answer the intent.
BsonnethighCode quality: structure, duplication, reuse of canonical definitions, and clarity.
D (statistical claims only)opushighStatistical validity: the estimand, the unit of assignment, the method's assumptions, multiplicity, and whether the conclusion follows from the interval.
C (high stakes only)haikuhighReproducibility: clean-process re-run (on synthetic data, or in the human's pasted runs), pinned dependencies, fixed seeds, and snapshot dates.

Add reviewer C only when the change is high stakes, and reviewer D only when the work makes a statistical claim (a test, an effect estimate, an interval, a model, or a segmentation), as the table shows.

Fill in references/reviewer-prompt.md for every reviewer with the intent, the code or notebook text, the rubric from references/rubric.md, and the code-quality lens from references/code-quality-review.md. Each reviewer applies the lens it is emphasizing and the other one as a second look.

Step 4, Synthesize

As results come back, build one picture. Parse each reviewer's findings. Merge findings that describe the same issue, and note which reviewers raised each one. A finding raised by both reviewers independently is the strongest signal. Read a lone finding and weight it accordingly. Note disagreements. If one reviewer flags something and the other says the opposite, that goes into the verdict as context.

Step 5, Lead judgment

You are the lead reviewer, a pragmatic senior analyst. You are not a neutral aggregator. Read references/lead-judgment.md for the framework. Sort every finding into one of four buckets, with the reviewer(s) that raised it and a one-line reason:

  • Act on: real issues that affect the correctness of a number, the reproducibility of a run, security, or maintainability. They would block a real PR or a shipped number.
  • Consider: legitimate, but unsure whether they outweigh the cost of fixing now. Worth the user's attention.
  • Noted: valid but not actionable now.
  • Dismissed: wrong, nitpicky, or missing context, with a brief reason.

Output format

Intent

The intent paragraph from Step 2

Reviewers

  • Reviewer [label]: [model], [N findings]

Act on

Each: the description, which reviewers raised it, and why it matters. Include the row count or the number it changes, when you can state it.

Consider

Each: the description, which reviewers raised it, and the tradeoff.

Noted

A brief list.

Dismissed

Each with a brief reason.

Agreement map

Where the reviewers agreed and where they diverged, and what the pattern says.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.