analysis-review
Skill0 starsChanged 53 days agoApache-2.0View on GitHub
Post-computation sanity checks: area weighting, autocorrelation in trends, baselines, projections, budget grid, uncertainty reported, smell-test ranges.
3 other projects use a version of this.
Adopted by
Most recently taken up by
- grace-method/grace-plugintheir own version, first seen Oct 25, 2026
- lancegui/causal-powerstheir own version, first seen Oct 13, 2026
- poteto0/my-skillstheir own version, first seen Feb 19, 2026
Other versions3 projects use a version of this.
Word for word · 0
None found.
Edited · 0
None found.
Wrote their own version · 3
- lancegui/causal-powers★ 2same name
- grace-method/grace-plugin★ 0same name
- poteto0/my-skills★ 0same name
How matches are found. Word for word: the exact same text. Edited: shares passages with this file (“99% same” means 99% of its five-word phrases also appear here; 10% or more counts). Their own version: similar meaning, or, weakest, the same name. We can’t tell which project had it first. Projects are counted among the 200 most-starred candidates, and mentions are links to the repository we found, up to 50 per site, so both counts are a floor.
In this repository11 other files it gives its agents.
- basic-statisticsSkill
- cartographySkill
- consult-knowledgeSkill
- data-formatsSkill
- discover-dataSkill
- quality-controlSkill
- reportSkill
- reproducibilitySkill
- startSkill
- uncertainty-quantificationSkill
- xarray-fundamentalsSkill
The file
We split this skill into the rules it gives an agent
6 rules. 0 are common, 6 are distinctive, and 0 are very specific to this project.
0
Common
Most of the 3 edited versions we read keep these.
6
Distinctive
This author's own choices. Worth a look.
0
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 72
Is uncertainty reported alongside the headline number?: Every headline quantity carries an interval, a spread, or a native product …
- Distinctive: line 101
Never pass an analysis with an unresolved 🔴.
- Distinctive: line 102
Never soften a missing-uncertainty finding to stylistic advice.
- Distinctive: line 104
Never invent an expected range, or remember one, when a concept states it.
- Distinctive: line 107
Never review prose alone when code and outputs are available.
- Distinctive: line 108
Never silently fix what the review found.
“Common” is measured: kept by at least 6 in 10 of the 3 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
analysis-review
The post-computation review: invocable directly ("review this analysis") and run before results are reported. Review what was computed (the code and outputs), not what the prose claims.
Consult the bundle (standing step)
This review carries NO expected numbers, dataset facts, or gotcha rules
of its own. Before flagging anything numeric or product-specific,
consult installed knowledge concepts first, as the consult-knowledge
skill sets out, and cite what each match constrains. In particular: the
cross-cutting sanity anchors live in conventions/smell-test-ranges.md;
a product's native uncertainty or quality layer lives in its dataset
concept's ## Uncertainty section; a quantity's expected range lives in
its domain recipe concept and the computation that recipe cites; a
trap's rule lives in its gotcha or convention concept. Never work from a
remembered number where a concept exists.
Verdict format
Each check gets an inline flag and one line of evidence:
- 🔴 wrong result likely; must be fixed before reporting
- 🟡 suspicious or incomplete; investigate or justify explicitly
- 🟢 clean
The review ends with an overall verdict; any unresolved 🔴 blocks the report. The review proposes fixes; it never silently applies them.
Methodology checklist
- Area weighting. Any spatial mean over a lat-lon grid without cos-lat or cell-area weights is 🔴 (xarray-fundamentals has the rule and the fix).
- Autocorrelation in trends. Original Mann-Kendall or uncorrected OLS significance on monthly or daily series is 🔴; check the method against basic-statistics' decision tree, and per-cell map claims against its FDR rule.
- Baselines. Climatology, anomaly, or percentile results without a stated baseline are 🔴; two compared series on different baselines without comment is 🔴; a trended record used as its own full-record baseline earns 🟡 unless the midpoint-centering is acknowledged.
- Projections and figures. Per cartography: jet or rainbow 🔴;
diverging colormap without a pinned physical center 🔴; missing
transform=🔴 (misplaced data); polar fields on PlateCarree 🟡; stippling, hatching, or bands undefined in the caption 🟡; comparable panels without a shared colorbar 🟡. - Budget grid (hard refusal: invariant, universal). Property budgets computed on regridded fields are 🔴, full stop; budgets close only on the native grid. This flag fires without consulting anything; the domain plugin's budget skills and gotcha concepts carry the formulation details, cited when present.
- Calendar and seasonal handling. DJF spanning the year boundary
via
groupby("time.season")is 🔴 for cross-year seasons; annual means of monthly data without month-length weighting 🟡. The rule and the fix live in the calendars convention concept (conventions/calendars.md); read and cite it, do not restate it. - QC lineage. Statistics computed before a fill-value audit are 🔴
if sentinels were present; no QC run at all on a new dataset is 🟡.
The sentinel list and detection recipe live in the fill-values
concept (
conventions/common-fill-values.md), consulted per the standing step, not carried here.
The three UQ checks
- Is uncertainty reported alongside the headline number? Every headline quantity carries an interval, a spread, or a native product uncertainty, or an explicit one-line waiver. Absent: 🔴.
- Is an ensemble mean shown without spread? 🔴; with fewer than about 10 members the spread must also be called a likely underestimate (uncertainty-quantification has the caveat).
- Does the product carry a native uncertainty or quality layer that the analysis ignored? Consult the dataset concept's Uncertainty section to know what exists. Ignored and material to the conclusion: 🔴; ignored and plausibly immaterial: 🟡 with a justification asked.
Smell-test ranges
The procedure: a headline value outside its anchor is 🔴 until
explained, inside but odd is 🟡. Do NOT carry or remember the anchor
values here. Read the cross-cutting anchors from the smell-test concept
(conventions/smell-test-ranges.md) per the standing step, and read a
domain quantity's expected range from its own domain recipe concept
(never hardcode a number that a recipe or the anchors concept states,
and never invent one when a concept exists). Restate and cite the anchor
you used.
Unit smells resolve most out-of-anchor values (invariant unit method, not a dataset fact): a 273-ish offset is K vs C; a factor ~30 on precipitation is mm/day vs mm/month; a factor 100 on fractions is percent vs fraction; a factor 1000 on transport is TW vs PW.
Must NOT (hard refusals and gates)
- Never pass an analysis with an unresolved 🔴.
- Never soften a missing-uncertainty finding to stylistic advice; it is 🔴 by the house rule.
- Never invent an expected range, or remember one, when a concept states it; read it from the recipe or the smell-test anchors concept and cite it.
- Never review prose alone when code and outputs are available.
- Never silently fix what the review found; propose, with the flag and the evidence.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

