agentleFS
Liberty91LTDLiberty91LTD/cti-skills/skills/devils-advocacy/SKILL.md

devils-advocacy

Skill35 starsChanged 46 days agoMITView on GitHub

Use when challenging a prevailing analytical judgment, the user asks "what is the opposing case?" / "argue the other side" / "play devil's advocate", or wants an assessment stress-tested before release. Takes the team's own lead judgment and builds the strongest case that it is wrong. A contrarian technique. It does not model what an adversary would do next, which is Red Team Analysis. Formerly /red-team-analysis.

The file

We split this skill into the rules it gives an agent

6 rules. About 0 are common, 5 are distinctive, and 1 is very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈5

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 1

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    When consensus is strong, this technique deliberately argues the opposing position.

    line 15
  2. Distinctive:

    Before publishing a product that will drive significant decisions

    line 22
  3. Very specific:

    Write the current analytical consensus clearly and completely.

    line 27
  4. Distinctive:

    Do they warrant lowering the confidence level?

    line 41
  5. Distinctive:

    Do they identify intelligence gaps that should be filled?

    line 42
  6. Distinctive:

    Do they suggest alternative hypotheses that should be tracked?

    line 43

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Devil's Advocacy

A contrarian technique from the CIA Tradecraft Primer. It takes the team's own lead judgment as its input and argues that the judgment is wrong. Its output is a rebuttal.

It is not Red Team Analysis. Red teaming is an imaginative technique: it reasons as the adversary would, from the adversary's position and constraints, and produces adversary courses of action. This pack does not have a Red Team Analysis skill. Until version 2.0 this skill carried that name.

When consensus is strong, this technique deliberately argues the opposing position. The goal is not to be contrarian for its own sake — it's to find genuine weaknesses in the prevailing analysis before they become blind spots.

When to Use

  • Consensus is strong and unchallenged
  • High-stakes assessment (wrong conclusion = significant harm)
  • Analysis has been produced quickly under pressure
  • The same team that collected also analysed (potential tunnel vision)
  • Before publishing a product that will drive significant decisions

Procedure

Step 1: State the Prevailing Judgment

Write the current analytical consensus clearly and completely. Where the judgment rests on graded evidence from /quality-of-information-check, take the claim table with it: the weakest load-bearing claim is the first place to press.

Step 2: Argue Against It (With Maximum Effort)

Deliberately and rigorously construct the best possible case AGAINST the prevailing judgment:

  • What evidence is being overweighted?
  • What alternative explanations exist for the same evidence?
  • What evidence has been ignored or underweighted?
  • What assumptions are vulnerable? (cross-reference with key-assumptions-check)
  • What would a sophisticated adversary do to make us believe the prevailing judgment?
  • What historical cases looked similar but turned out differently?

Step 3: Assess the Opposing Case

Honestly evaluate:

  • Are any of the opposing arguments compelling enough to change the judgment?
  • Do they warrant lowering the confidence level?
  • Do they identify intelligence gaps that should be filled?
  • Do they suggest alternative hypotheses that should be tracked?

Step 4: Report

## Devil's Advocacy: [Prevailing Judgment]

### Prevailing Judgment
[The assessment being challenged]

### The Case Against
[The best case against the prevailing judgment]

#### Overweighted Evidence
- [Evidence that may be given too much weight, and why]

#### Alternative Explanations
- [Alternative explanations for the same evidence]

#### Ignored/Underweighted Evidence
- [Evidence pointing away from the prevailing judgment]

#### Vulnerable Assumptions
- [Assumptions the prevailing judgment depends on]

### Assessment of the Case Against
[How compelling is it?]
- **Compelling**: Prevailing judgment should be revised
- **Partially compelling**: Confidence should be lowered
- **Not compelling**: Prevailing judgment stands, but the exercise identified useful intelligence gaps

### Recommendations
- [Actions: revise judgment, lower confidence, collect against gaps, track alternative hypothesis]

Rules

  • Argue with genuine effort — a weak devil's advocate is worse than none
  • Separate the devil's advocate from the original analysis (different perspective, ideally different analyst)
  • The findings must be incorporated into the final product
  • A strong case against doesn't mean the original was wrong — it means we're more confident (or appropriately less confident) in the result

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.