metrics-definition
Skill5 starsChanged 2 months agoMITView on GitHub
Precise metric definitions for data products. Outcome metric trees, naming conventions, grain specification, and the "what does this number mean?" problem. Use when defining KPIs, writing metric specifications, resolving conflicting metric definitions, building a metrics catalog, or when someone asks "how should we measure success?" or "why don't these numbers match?"
4 other projects use a version of this.
Adopted by
Most recently taken up by
- zpower426/pmpowerstheir own version, first seen Oct 20, 2026
- miovrag/claude-skillstheir own version, first seen Jun 12, 2026
- nbirkner/digital-braintheir own version, first seen Apr 12, 2026
- launchapp-dev/animus-clitheir own version, first seen Mar 15, 2026
Other versions4 projects use a version of this.
Word for word · 0
None found.
Edited · 0
None found.
Wrote their own version · 4
- launchapp-dev/animus-cli★ 39same name
- miovrag/claude-skills★ 1same name
- nbirkner/digital-brain★ 0same name
- zpower426/pmpowers★ 0same name
How matches are found. Word for word: the exact same text. Edited: shares passages with this file (“99% same” means 99% of its five-word phrases also appear here; 10% or more counts). Their own version: similar meaning, or, weakest, the same name. We can’t tell which project had it first. Projects are counted among the 200 most-starred candidates, and mentions are links to the repository we found, up to 50 per site, so both counts are a floor.
In this repository24 other files it gives its agents.
- CLAUDE.mdCLAUDE.md
- analystSkill
- arbitrage-audit-dataSkill
- dashboards-to-decisionsSkill
- databricks-data-product-reviewSkill
- data-consumer-discoverySkill
- data-model-designSkill
- data-pipeline-qualitySkill
- data-product-operatorSkill
- data-product-thinkingSkill
- data-product-validationSkill
- data-quality-assessmentSkill
- data-storytellingSkill
- data-team-operating-modelSkill
- data-team-positioningSkill
- duckdb-data-profilingSkill
- ethical-risk-assessmentSkill
- grill-me-dataSkill
- healthcare-cohort-designSkill
- healthcare-data-domainSkill
- healthcare-data-readiness-debriefSkill
- healthcare-data-reconciliationSkill
- research-synthesis-dataSkill
- stakeholder-alignmentSkill
The file
Show its rules and text
We split this skill into the rules it gives an agent
13 rules. About 0 are common, 12 are distinctive, and 1 is very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈12
Distinctive · estimate
This author's own choices. Worth a look.
1
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 19
Every metric must specify:
- Distinctive: line 31
Never define a metric without specifying grain and time window.
- Distinctive: line 44
Every metric at a lower level should causally influence the level above.
- Distinctive: line 59
Use consistent patterns so metrics are discoverable:
- Very specific: line 68
AVOID abbreviations unless they are universally understood in your domain.
- Distinctive: line 72
If two reports show different values for the "same" metric:
- Distinctive: line 73
Check the grain (are they aggregating at different levels?)
- Distinctive: line 74
Check the time window (calendar month vs trailing 30 days?)
- Distinctive: line 75
Check the filters (are they including/excluding the same populations?)
- Distinctive: line 76
Check the source (are they querying different tables?)
- Distinctive: line 82
When charts represent your metrics:
- Distinctive: line 84
Use colorblind-safe palettes.
- Distinctive: line 86
Never use dual Y-axes. They let you imply any correlation by adjusting the scale.
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
The Core Problem
"47 dashboards and no answers." The failure mode is building metrics without agreeing on what they mean. "Revenue" means three different things to three different teams. "Active users" has no agreed-upon time window. Fix the definitions before building the dashboards.
Metric Definition Template
Every metric must specify:
- Name: Human-readable, follows naming convention (see below)
- Business definition: One sentence a non-technical person understands
- SQL logic: Exact calculation including numerator, denominator, and filters
- Grain: What level is this calculated at? (daily, weekly, per-user, per-account)
- Time window: What period does this cover? (trailing 7 days, calendar month, since signup)
- Dimensional attributes: What can you slice this by? (region, product line, customer segment)
- Owner: Who maintains this definition?
- Update cadence: How often does this refresh?
- Known edge cases: What situations produce unexpected results?
Never define a metric without specifying grain and time window. "Monthly active users" means nothing until you define what "active" means and whether "monthly" is calendar month or trailing 30 days.
Outcome Metric Trees
Connect metrics from business outcomes down to leading indicators:
Business outcome: Reduce hospital readmissions 10%
Product outcome: Clinical decisions made 3x faster
Feature outcome: Risk scores updated in real-time
Leading indicator: Query latency under 1 secondEvery metric at a lower level should causally influence the level above. If you can't draw the causal link, the metric doesn't belong in the tree.
Trust Metrics
Alongside performance metrics, track trust:
- Data accuracy rate: Percentage of values matching gold standard (target: 99.9%)
- Query response time: P95 latency for consumer queries (target: <3 seconds)
- Data freshness: Time between source update and availability (target: within SLA)
- Support response time: How fast you resolve data questions (target: <24 hours)
- Incident count: Zero algorithmic bias incidents, zero data breaches
Trust metrics matter because a single bad number in a board deck costs more credibility than a delayed feature.
Naming Conventions
Use consistent patterns so metrics are discoverable:
count_<thing>for counts (count_active_patients, count_claims_submitted)rate_<thing>for ratios (rate_readmission_30day, rate_claim_denial)avg_<thing>for averages (avg_length_of_stay_days, avg_time_to_resolution)pct_<thing>for percentages (pct_records_complete, pct_goals_met)sum_<thing>for totals (sum_charges, sum_paid_amount)
Include the unit in the name when ambiguous: avg_length_of_stay_days not avg_los.
AVOID abbreviations unless they are universally understood in your domain. mrr is fine for SaaS. los is fine for healthcare. ttfv is not fine for anyone.
When Numbers Don't Match
If two reports show different values for the "same" metric:
- Check the grain (are they aggregating at different levels?)
- Check the time window (calendar month vs trailing 30 days?)
- Check the filters (are they including/excluding the same populations?)
- Check the source (are they querying different tables?)
The fix is always a single source of truth with an explicit definition, not reconciling two conflicting reports.
Metric Visualization
When charts represent your metrics:
- Use colorblind-safe palettes. 8% of men have color vision deficiency. Your VP of Sales might be one of them.
- Label data directly on the chart. Legends force the reader to look away from the data.
- Never use dual Y-axes. They let you imply any correlation by adjusting the scale.
For presentation structure, chart selection, and narrative framing, see data-storytelling.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

