okhp3-outcome-modeling-core
Skill3 starsChanged 2 months agoMITView on GitHub
Design and operationalize outcome models that compress noisy event histories into calibrated forecasts and constrained decisions. Use when a user asks about feature reduction, probability, expected value, aggregation, or moving a prediction method between sports, business, sales, advertising, finance, or prediction markets. Load a domain adapter when one fits.
In this repository57 other files it gives its agents.
- AGENTS.mdAGENTS.md
- .agents/skills/vercel-react-best-practices/agents.mdAGENTS.md
- CLAUDE.mdCLAUDE.md
- architecture-decision-recordsSkill
- catalog-integritySkill
- frontend-designSkill
- okhp3-artifact-validationSkill
- okhp3-as-is-process-captureSkill
- okhp3-brand-style-registrySkill
- okhp3-capture-intakeSkill
- okhp3-chatgpt-project-migrationSkill
- okhp3-custom-gpt-builderSkill
- okhp3-custom-gpt-readinessSkill
- okhp3-decision-model-authoringSkill
- okhp3-elicitation-interviewsSkill
- okhp3-equilibrium-reviewSkill
- okhp3-evidence-standardSkill
- okhp3-future-state-strategySkill
- okhp3-gpt-skill-conversion-planSkill
- okhp3-graduation-gateSkill
- okhp3-handoff-packagingSkill
- okhp3-notion-capture-routerSkill
- okhp3-overkill-hill-brandSkill
- okhp3-process-captureSkill
- okhp3-process-gap-analysisSkill
- okhp3-process-intake-and-scopeSkill
- okhp3-project-promotionSkill
- okhp3-replit-build-in-publicSkill
- okhp3-replit-canvas-boardSkill
- okhp3-replit-design-pipelineSkill
- okhp3-replit-free-mode-autonomySkill
- okhp3-replit-github-syncSkill
- okhp3-replit-multi-artifactSkill
- okhp3-replit-repl-janitorSkill
- okhp3-replit-repository-janitorSkill
- okhp3-replit-task-executorSkill
- okhp3-repository-janitorSkill
- okhp3-repository-organizerSkill
- okhp3-session-handoffSkill
- okhp3-skill-catalogerSkill
- okhp3-skill-discoverySkill
- okhp3-skill-foundrySkill
- okhp3-source-backed-researchSkill
- okhp3-thread-context-extractionSkill
- okhp3-thread-extract-chatgptSkill
- okhp3-thread-extract-claudeSkill
- okhp3-triage-and-fileSkill
- okhp3-vite-github-pagesSkill
- production-build-verificationSkill
- published-keyboard-recovery-checkSkill
- publish-health-checkSkill
- publishing-trigger-checkSkill
- static-route-validationSkill
- validation-smokeSkill
- vercel-react-best-practicesSkill
- web-design-guidelinesSkill
- okhp3-skill-promotionSkill
The file
We split this skill into the rules it gives an agent
12 rules. About 0 are common, 11 are distinctive, and 1 is very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈11
Distinctive · estimate
This author's own choices. Worth a look.
1
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 52
Treat a complex system as a noisy, time-indexed process:
- Very specific: line 62
Use the formulas, glossary, synthetic fixture, and deterministic helper supplied with this package.
- Distinctive: line 82
Do not optimize accuracy by default.
- Distinctive: line 88
Use a state vector when many observations describe the same entity:
- Distinctive: line 94
Use an interaction or delta representation when two entities jointly determine an outcome:
- Distinctive: line 108
Do not assume aggregation makes outcomes 50/50.
- Distinctive: line 112
Create a feature inventory with source, definition, unit, grain, polarity, cadence, missingness, and leakage risk.
- Distinctive: line 114
Test nested feature tiers such as 10, 30, 60, 120, and 200 only when the dataset supports them.
- Distinctive: line 119
Use as-of joins and lagged rolling features.
- Distinctive: line 129
If the recommendation changes the system, separate prediction from treatment effect.
- Distinctive: line 131
Never infer that a high-performing entity caused its outcome merely because it was associated with it.
- Distinctive: line 161
If required data is absent, produce a model specification and data request rather than invented numbers.
≈ “Common” is an estimate: at least 1 in 5 of the 364,980 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
okhp3-outcome-modeling-core
OverKill Hill P³ · overkillhill.com · github.com/OKHP3
Build a defensible model for systems where many noisy events contribute to a measurable outcome. The core separates the shared world model from the decision objective, so the same evidence can support forecasting, ranking, budgeting, or market comparison without confusing prediction with optimization.
Scope
| In scope | Out of scope |
| Repeated event histories, state vectors, and aggregate outcomes | A universal algorithm that fits every dataset |
| Feature reduction and diminishing-returns testing | Claims that a fixed feature count always explains 95% of outcomes |
| Calibrated forecasts and decision-ready uncertainty | Presenting a forecast as certainty or advice without constraints |
| Domain-adapter routing and handoff contracts | Live trading, betting, or political targeting |
Core mental model
Treat a complex system as a noisy, time-indexed process:
events -> entity state -> outcome estimate -> objective and constraints -> decisionAggregation can reduce the relative influence of idiosyncratic noise, but it does not erase causal structure, dependencies, or meaningful rare events. The goal is to expose persistent signal while preserving uncertainty and time order.
Computational payload
Use the formulas, glossary, synthetic fixture, and deterministic helper supplied
with this package. Read references/computational-model.md for the event-to-state,
logistic, feature-tier, calibration, and decision equations. Read
references/glossary.md before using unfamiliar terms. Run
scripts/calculate-outcome-model.py examples/core-example.json to reproduce the
small arithmetic example. The helper reads local JSON, prints JSON, and performs
no network access or writes.
Operating procedure
1. Define the decision before the model
Record:
- target outcome and unit of analysis;
- forecast horizon and as-of timestamp;
- decision owner and action window;
- utility, cost, budget, risk tolerance, and hard constraints;
- whether the task is descriptive, predictive, causal, or allocative.
Do not optimize accuracy by default. A probability forecast, expected value estimate, ranking, and budget allocation are different products.
2. Build the event-to-state representation
Identify the entity, event, relationship, and time grain. Preserve raw observations, sample sizes, missingness, and provenance. Derive an entity state only from information available at the as-of time.
Use a state vector when many observations describe the same entity:
state(entity, t) = transformed features available at tUse an interaction or delta representation when two entities jointly determine an outcome:
delta(A, B, t) = state(A, t) - state(B, t)3. Aggregate at multiple scales
Inspect the smallest meaningful events, then roll them up through the operational hierarchy. Name each aggregation because different scales answer different questions.
event -> session or possession -> period -> case or game -> season or cohortDo not assume aggregation makes outcomes 50/50. It generally stabilizes estimates of persistent effects. Strong asymmetries can remain.
4. Compress features without hiding structure
Create a feature inventory with source, definition, unit, grain, polarity, cadence, missingness, and leakage risk. Group correlated variables under interpretable factors, but retain the raw fields for auditability.
Test nested feature tiers such as 10, 30, 60, 120, and 200 only when the dataset supports them. Compare each tier to a simple baseline using time-aware out-of-sample metrics. Stop adding variables when incremental value is negligible, unstable, or caused by leakage.
5. Validate in time and across entities
- Split by time, not random rows, when future prediction is involved.
- Use as-of joins and lagged rolling features.
- Hold out later periods or entities when generalization matters.
- Compare calibration, log loss, Brier score, ranking quality, and decision value as appropriate.
- Inspect subgroup and segment performance.
- Recheck drift after structural changes, interventions, or regime shifts.
Accuracy alone is insufficient. A model can rank well but be poorly calibrated, or forecast well while producing a bad allocation under costs and constraints.
6. Add causal and intervention checks
If the recommendation changes the system, separate prediction from treatment effect. Ask what would have happened without the action. Use experiments, holdouts, natural experiments, or a clearly labeled observational design when appropriate.
Never infer that a high-performing entity caused its outcome merely because it was associated with it. Check selection bias, confounding, reverse causation, and opportunity assignment.
7. Produce the decision layer
Choose an explicit objective such as:
expected outcome
- monetary cost
- capacity cost
- downside risk
+ retention, option, or spillover valueState the optimization rule, constraints, assumptions, and what would change the recommendation. When a market price or benchmark exists, compare independent estimate, implied probability, uncertainty, and transaction or implementation cost.
Output contract
Return, as applicable:
- objective, target, horizon, and as-of boundary;
- data and provenance inventory;
- event-to-state and aggregation ladder;
- feature groups and excluded or leaky fields;
- baseline and candidate model comparison;
- calibration, uncertainty, drift, and subgroup checks;
- objective function and constraints;
- ranked options or allocation with rationale;
- unresolved assumptions and the next validation step.
If required data is absent, produce a model specification and data request rather than invented numbers.
Family routing
Load this skill first, then add the narrowest adapter:
okhp3-outcome-modeling-sportsfor team, game, or player outcomes;okhp3-nfl-fantasy-picksfor NFL fantasy rosters and salary-constrained picks;okhp3-outcome-modeling-salesfor pipeline, rep, account, and commercial value;okhp3-outcome-modeling-marketsfor prediction-market prices and expected value.
References
references/computational-model.md-- shared equations and worked example.references/glossary.md-- plain-language definitions and abbreviations.examples/core-example.json-- synthetic input fixture.scripts/calculate-outcome-model.py-- dependency-free local calculator.okhp3-outcome-modeling-sports/SKILL.md-- sports state and matchup adapter.okhp3-nfl-fantasy-picks/SKILL.md-- NFL fantasy decision adapter.okhp3-outcome-modeling-sales/SKILL.md-- commercial value and sales adapter.okhp3-outcome-modeling-markets/SKILL.md-- market-price and risk adapter.
About
Built by Jamie Hill · OverKill Hill P³ Published at github.com/OKHP3 Part of the OKHP3/skillz Agent Skill library. MIT License -- free to use, fork, and adapt. A nod to the source is appreciated.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

