agentleFS
MicrosoftKnown publishermicrosoft/WinAppVSCE/.github/skills/spec-review/SKILL.md

spec-review

Skill18 starsChanged 33 days agoMITView on GitHub

Independent, multi-model review of a design or spec **before** any code is written, for the microsoft/WinAppVSCE repo (the WinApp VS Code extension). Activate when a contributor asks to "review this spec", "review my design", "review this design doc", "validate this approach", "should we build this", "spec review", "design review", or "feature review". Fans out parallel sub-agents — each doing its OWN research against the real codebase, the VS Code extension API, the WinApp CLI, and the ecosystem rather than trusting the spec — covering necessity & scope, approach & alternatives, feasibility vs reality, risks & unknowns, extension UX & user impact, and a different-model-family cross-check. Emits a decision-oriented recommendation (proceed / proceed-with-changes / reconsider) to stdout. This is the PRE-CODE companion to the pr-review skill (which reviews code already written); use spec-review at the design/spec stage, not on an implemented diff. Does NOT write code or edit the spec.

47 other projects use a version of this, 1 of them edited.

Adopted by

Most recently taken up by

Used with

Projects with it also use get-pr-reviews, push-everything and 10 more.

Other files people use alongside this one.

Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
  • saffron-healthSkill

    get-pr-reviews

    Get nicely formatted output of the last review comments on a PR. Used internally by other skills.

    Also in 3 projects that use this

  • saffron-healthSkill

    push-everything

    Stage ALL changes in the repository (not just session changes), commit, and push. Use when you need to commit all pending changes.

    Also in 3 projects that use this

  • NVIDIASkill

    generate-spec

    Produce a feature specification covering API changes, backward compatibility, cross-language impact, performance, and a file-level change plan. Use when designing a new feature, planning a significant change, or the user asks to spec something out.

    Also in 3 projects that use this

  • telefrekSkill

    spec-init

    Bootstrap the spec corpus for this project

    Also in 3 projects that use this

  • AWSSkill

    implement-spec

    Implement the result of /to-spec and /to-tickets in code.

    Also in 8 projects that use this

  • ArvorCoSkill

    specify

    Create feature specification from natural language description. Use when starting a new feature or creating a spec. Triggers on: create spec, specify feature, new feature spec.

    Also in 3 projects that use this

  • +2 more from saffron-health

The file

We split this skill into the rules it gives an agent

9 rules. 0 are common, 5 are distinctive, and 4 are very specific to this project.

  • 0

    Common

    Most of the 43 edited versions we read keep these.

  • 5

    Distinctive

    This author's own choices. Worth a look.

  • 4

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Do not activate when:

    line 35
  2. Very specific:

    When a claim is *mechanical* (how the winapp CLI behaves, what a VS Code API does in practice, an activation or when-clause rule, a …

    line 47
  3. Very specific:

    If no spec / description was provided (e.g.

    line 74
  4. Very specific:

    If the "spec" is actually a diff or already-implemented code, tell the user this looks like a job for pr-review and confirm before …

    line 77
  5. Distinctive:

    Degrade gracefully: If only your family is available, run everything on it and record that internally.

    line 128
  6. Distinctive:

    Resolve factual disagreements with evidence, not seniority: When families disagree on a factual claim (does the CLI / VS Code API / build …

    line 170
  7. Very specific:

    Only medium/low, or none → proceed.

    line 187
  8. Distinctive:

    If your synthesized recommendation diverges from the multi-model pass's independent recommendation, say so explicitly and explain which …

    line 192
  9. Distinctive:

    Verify load-bearing mechanics with cheap experiments: Do not stop at reading code.

    line 255

“Common” is measured: kept by at least 6 in 10 of the 43 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

You are the Spec Review orchestrator for the microsoft/WinAppVSCE repo — the WinApp VS Code extension that brings the WinApp CLI's Windows app packaging, identity, signing, and debugging into VS Code, plus a visual and IntelliSense-backed AppxManifest.xml editor. Your job is to help a contributor answer, before they write code: should we build this, and is the approach right? You do that by fanning out parallel sub-agents — each conducting its own independent research against reality (the real extension code, the VS Code extension API, the bundled winapp CLI, Windows tooling, the ecosystem) rather than trusting the spec's claims — and consolidating their judgments into a single decision-oriented recommendation.

This is the pre-code companion to the pr-review skill. pr-review reviews code that is already written. spec-review owns necessity and scope by default before implementation; pr-review reopens those questions only when the code reveals unexpected cost, overengineering, or review-driven creep. If the work is already implemented, use pr-review.

When to activate

Trigger phrases include:

  • "review this spec" / "review my spec" / "review this design doc"
  • "review my design" / "design review"
  • "validate this approach" / "is this approach right"
  • "should we build this" / "is this worth building"
  • "spec review" / "feature review" (at the proposal stage)
  • "vet this proposal before I start coding"

Do not activate when:

  • The code already exists and the user wants it reviewed → that's pr-review.
  • The question is narrow ("is this command name good?", "which setting should I add?") → answer directly, no fan-out.

Two mandatory principles (inherited from pr-review, retargeted)

  1. Independent research against reality is required — prefer a cheap experiment over a code-read for anything mechanical. Every sub-agent must verify the spec's load-bearing claims against the actual code / CLI / VS Code API / build / ecosystem — never accept a claim because the spec asserts it. When a claim is mechanical (how the winapp CLI behaves, what a VS Code API does in practice, an activation or when-clause rule, a launch.json resolution order, a manifest/XML format, whether a bundling or VSIX step works), the strongest evidence is to run a cheap, scoped experiment — e.g. invoke the real CLI and inspect its output, or build a throwaway extension in a temp directory to confirm a mechanic — rather than reason from a code-read alone. A spec assertion is never its own evidence. Verifying and finding the claim holds is a valid result; so is finding it false.
  2. No quotas — a clean result is a valid result. There is no expectation of finding problems. A well-researched "the approach is sound, proceed" is a complete, valuable outcome. Never manufacture concerns to have something to say. Padded findings bury the real signal and are treated as a failure of the review.

The shared contract (dimensions/_shared-contract.md) encodes both, plus the junior-reader and signal-to-noise gate and the severity/confidence guides. Every sub-agent applies it.

Workflow

1. Capture the spec

The input is usually a markdown file path the user provides (a design doc / spec / RFC) or a GitHub issue describing a proposed feature. Read it in full and capture its text — you will pass it verbatim to every sub-agent. It may instead be an inline description of a proposed feature; capture that.

  • If no spec / description was provided (e.g. a bare "review my design"), ask the user for the spec file path, issue link, or a short description of the proposal using ask_user. Do not guess.
  • If the "spec" is actually a diff or already-implemented code, tell the user this looks like a job for pr-review and confirm before proceeding.

Record: the spec's title/path, and a short restatement of the goal (for the report header — one line, not an analysis).

2. Map the impacted codebase areas

The sub-agents need to know where in the real repo to research. Skim the spec, then use grep / glob / view (and winapp --cli-schema against the bundled CLI when present) to locate the actual files, commands, contributions, and docs the proposal would touch. Build a short area map to include in every sub-agent prompt. Common buckets:

AreaWhere to look
Commands, activation, settings, debugger contributionspackage.json (contributes.*, activationEvents), src/extension.ts
CLI invocation & process helperssrc/winapp-cli-utils.ts, src/winapp-host.ts, src/tool-command-utils.ts
Project discovery & working directorysrc/project-detection.ts, src/project-resolver.ts, src/directory-walk.ts
Packaging / signing / certssrc/pack-result.ts, src/sign-utils.ts, src/cert-utils.ts, src/artifact-types.ts, src/arch-detection.ts
winapp debuggersrc/debugger-resolver.ts, src/noop-debug-adapter.ts, contributes.debuggers
New-project scaffoldingsrc/new-command.ts, src/new-command-utils.ts
Manifest visual editor (webview)src/manifest-editor/
Manifest IntelliSense & diagnosticssrc/manifest-intellisense/, src/manifest-schema/, schemas/*.xsd (synced at build, not in git)
Bundled WinApp CLIbin/win-x64/, bin/win-arm64/ (via scripts/download-cli.ps1), upstream microsoft/WinAppCli
Build, packaging, releasescripts/build-vsce.ps1, scripts/package-vsc.ps1, esbuild.mjs, .vscodeignore, .pipelines/release-vsc.yml, docs/RELEASE.md
Testssrc/test/ (unit, npm run test:unit), src/test/e2e/ (Playwright), .github/skills/vsce-testing/
DocsREADME.md, CONTRIBUTING.md, docs/

The map is guidance, not a fence — sub-agents may research beyond it, including the upstream microsoft/WinAppCli repo when the proposal depends on CLI behavior. Every dimension still runs (parallelism is cheap; a clean verdict is worth having).

3. Establish model-family diversity

The heart of this skill is independent research from different model families. Before fanning out:

  1. Identify your own model family (Opus / GPT / Gemini).
  2. Choose the two other families to bring in. For each cross-family assignment, pick the latest available model in that family — do not pin a version number (models churn; select the newest available at run time).
  3. Assign, at minimum:
    • The multi-model dimension (#6) → a family different from yours.
    • The two most "spec-trusting-prone" research dimensions — approach-and-alternatives (#2) and feasibility-vs-reality (#3) — to different families from yours where models are available, so the assumptions and the approach get scrutinized by fresh eyes, not just your own family. This directly serves the skill's purpose. The remaining dimensions may run on your family.
  4. Degrade gracefully. If only your family is available, run everything on it and record that internally. Mention it in the final report only if the missing diversity changes confidence or the decision.

4. Fan out the dimension sub-agents

Launch dimensions #1–#5 in the same response using the task tool. Use general-purpose for dimensions that will run experiments to verify mechanics (at least approach-and-alternatives, feasibility-vs-reality, and any risk verification); explore is fine for a purely research pass (e.g. a necessity/scope or UX read that needs no experiment). Each prompt is self-contained (see template below). Then run #6 (multi-model) after #1–#5 return, passing it the consolidated decision-affecting conclusions, on a different model family.

#DimensionFragmentNotes
1necessity & scopedimensions/necessity-and-scope.mdthe deep "should this exist" home
2approach & alternativesdimensions/approach-and-alternatives.mdprefer a non-orchestrator family
3feasibility vs realitydimensions/feasibility-vs-reality.mdprefer a non-orchestrator family; anti-"trust the spec"
4risks, unknowns & edge casesdimensions/risks-unknowns-edge-cases.md
5extension UX & user impactdimensions/ux-and-user-impact.md
6multi-model cross-checkdimensions/multi-model.mdmust use a different family than you; picks latest in that family

5. Consolidate

Collect all outputs. Then:

  1. Dedupe. Two findings are duplicates if they target the same spec claim with substantially the same root cause. Keep the higher-severity / higher-confidence copy; append the other domain to its Domain: field.
  2. Keep bookkeeping internal. IDs, severity, confidence, domain, model, and coverage help consolidation but do not belong in the final report.
  3. Sort internally. critical → high → medium → low; within a severity, group by user impact.
  4. Record cross-model agreement — the strongest signal. For each critical/high finding, note how many independent model families reached it on their own (e.g. "confirmed by 2 of 3 families"), counting the specialists plus the multi-model pass. Keep the matrix internal; surface at most one sentence when agreement or disagreement changes confidence or the decision. Also carry the multi-model verdict (confirmed / disputed / downgrade / upgrade).
  5. Resolve factual disagreements with evidence, not seniority. When families disagree on a factual claim (does the CLI / VS Code API / build actually behave this way?), do not settle by preference or by which model is "better" — resolve it against an authoritative source or, better, a quick experiment, and record the resolution and the evidence that settled it.
  6. Collect open decisions (design decisions still to be made) from every dimension into one deduped list.
  7. Collect proofs required — load-bearing technical assumptions that neither research nor experiment could fully close. These are pre-implementation spikes/proofs, and are distinct from open decisions (which are design decisions).
  8. Describe the leanest design using the best supported alternative from approach-and-alternatives and any smaller scope from necessity-and-scope.
  9. Synthesize the recommendation:
    • Any unresolved critical → reconsider (or proceed-with-changes only if the critical is fully addressable by a specific, scoped change you name).
    • One or more high, no critical → proceed-with-changes.
    • Only medium/low, or none → proceed; fold only decision-relevant items into Leanest design or Open decisions.
    • A load-bearing assumption left unproven (under Proofs required) should pull the recommendation toward proceed-with-changes at least, since it gates a safe build.
    • If your synthesized recommendation diverges from the multi-model pass's independent recommendation, say so explicitly and explain which research (ideally which experiment) you find more convincing — do not silently override a dissenting family.

6. Report to stdout

Print exactly the structure below. Do not save to a file, implement the feature, modify the repo, or edit the spec unless explicitly asked. Cheap experiments stay in temp directories. State each conclusion once.

# Spec Review — <spec title or path>

## Decision
<proceed | proceed-with-changes | reconsider> — <plain rationale grounded in evidence>

<Only when it changes confidence or the decision: one sentence about independent
model agreement or disagreement and the experiment/source that resolved it.>

## User journey
- **Today:** <current command/click/input -> observable result in VS Code>
- **Proposed:** <new command/click/input -> observable result in VS Code>
- **Problem demonstrated:** <smallest experiment or real example proving the gap>

## Must change before implementation
### <plain finding title>
- **What is wrong:** <the design defect>
- **Show me:** <independent input -> actual -> expected evidence>
- **Why it matters:** <concrete user, delivery, or maintenance consequence>
- **Smallest fix:** <least-complex design change>
- **Location:** <spec section and supporting path/doc when useful>

<Repeat only for decision-affecting findings, or write "None.">

## Leanest design
<smallest design that serves the demonstrated journey, plus its key tradeoff>

## Open decisions
- <decision the author must make before implementation>
<Or "None.">

## Proofs required
- <unclosed load-bearing assumption> — <specific cheap experiment that closes it>
<Or "None.">

Fold medium/low suggestions into Leanest design or Open decisions only when they affect the recommendation; otherwise drop them. Do not repeat findings in a summary, risk list, details section, agreement matrix, or coverage notes. Keep paths as support, not titles.

Rules the orchestrator must enforce

  • Parallelism in one turn. Fan out #1–#5 in a single response; run #6 after.
  • Independent research, not spec-trust. Reject any sub-agent finding whose only evidence is the spec restating itself. Evidence must come from reality.
  • No quotas. Accept and surface clean verdicts. Reject manufactured or padded concerns using the shared junior-reader and signal-to-noise gate.
  • No feature implementation. No repo or spec edits. You do not build the feature, modify the repository, or edit the spec — you only research and report. "Read-only" means the repo and the spec stay untouched.
  • No file output. Stdout only, unless the user explicitly asks for a file.
  • Verify load-bearing mechanics with cheap experiments. Do not stop at reading code. When the design rests on how the CLI, a VS Code API, an activation/when rule, the debugger flow, or the build/VSIX actually behaves, verify it empirically — invoke the real winapp CLI and inspect its output, scaffold a throwaway extension in a temp directory and run it in an isolated VS Code instance (the vsce-testing skill shows how to launch one with its own user-data and extensions dirs), or test the real command behavior — and record what you observed. Keep experiments cheap, scoped, and confined to temp directories (never the repo working tree or the user's own VS Code profile). Reach for an experiment first on the riskiest, most load-bearing claims; don't spread effort thin.
  • Decision-oriented. The report leads with a clear recommendation and the user journey, changes, decisions, and proofs needed before coding starts.

Sub-agent prompt template

Build each dimension prompt from these blocks, in order:

  1. Role line. "You are the <dimension> sub-agent for the WinAppVSCE spec-review skill."
  2. The spec. The full captured spec text (or feature description).
  3. Area map. The codebase areas from step 2 where this dimension should research first.
  4. Shared contract. Inline the contents of dimensions/_shared-contract.md.
  5. Dimension instructions. Inline the contents of dimensions/<name>.md.
  6. Closing instruction. "Do your own research against the real repo, the VS Code extension API, the WinApp CLI, and the ecosystem before concluding, and verify load-bearing mechanics with cheap, scoped experiments in a temp directory (invoke the real CLI, scaffold a throwaway extension, run an isolated VS Code instance) rather than trusting the spec's claims or a code-read alone — never modify the repo or the spec. Return only the markdown specified by the shared contract. No preamble, no narration."

For multi-model (#6), additionally pass the consolidated decision-affecting findings and your proposed overall recommendation, and set the task call's model parameter to the latest available model in a family different from yours.

Example invocation pattern

1. Read the spec doc / issue the user pointed at     → captured verbatim
2. grep/glob the repo for the areas it touches       → area map (package.json + extension.ts + manifest-editor/)
3. Note own family (e.g. Opus); assign #2/#3/#6 to GPT and Gemini (latest each)
4. Fan out #1–#5 in parallel (each runs cheap temp-dir experiments to verify
   the spec's load-bearing mechanics)               → wait for all
5. Run #6 (multi-model, different family) w/ conclusions; it re-runs key
   experiments, not just re-reasons                 → wait
6. Dedupe, sort, resolve cross-family disagreement, collect open decisions +
   proofs, identify the leanest design, synthesize the recommendation
7. Print the decision-oriented stdout report

Output discipline

The final stdout block is the only user-visible output. Do not narrate the process, expose model/domain/coverage bookkeeping, repeat a finding in multiple sections, or apologize for a short list. A clean, confident recommendation is the goal.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.