kumo-model-explanations
Skill34 starsChanged 23 days agoApache-2.0View on GitHub
Inspect and interpret gradient attribution (including requests called radiant attribution), column analysis and sampled explanation subgraphs from a Kumo model trained in a Python notebook. Locate the correct run's explanation artifacts, explain feature scores and cohorts, and identify missing or unsupported explanations without automatically retraining.
We split this skill into the rules it gives an agent
6 rules. About 0 are common, 5 are distinctive, and 1 is very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈5
Distinctive · estimate
This author's own choices. Worth a look.
1
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 8
Use this skill for questions such as “which columns influenced this model?”, “show gradient attribution”, or “compare predictions and …
- Distinctive: line 19
If several runs or trainer/refit directories exist, list candidates and resolve which one the user means.
- Distinctive: line 24
Read the artifact workflow for discovery, executable readers, generation behavior, and source provenance.
- Distinctive: line 68
Do not rank these three score families in one list or treat their differences as calibration error.
- Distinctive: line 69
Use the cohort means for descriptive prediction-versus-target comparisons.
- Very specific: line 82
Keep this task focused on inspection and interpretation.
≈ “Common” is an estimate: at least 1 in 5 of the 308,232 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Kumo model explanations
Use this skill for questions such as “which columns influenced this model?”, “show gradient
attribution”, or “compare predictions and observed outcomes by column cohort”. Kumo calls the
method gradient attribution/scoring, not Radiant. Work in the existing Snowflake notebook
with its in-process kumo.engine runtime and retained local run files.
Establish the run and question
- Reuse the user's task, model, graph, and run identity. Do not restart training intake.
- For a fresh
training_result,Path(training_result.bundle_dir).parentidentifies that fit's run directory in the reviewed implementation. Otherwise use the retained run directory the user supplied. A downloaded model bundle is not the original training run. - If several runs or trainer/refit directories exist, list candidates and resolve which one the user means. Never silently select the newest directory or combine different runs.
- Identify the task type, target/positive class, explanation stage, and fit/refit used. Record unknowns explicitly. These determine what the scores can mean.
Read the artifact workflow for discovery, executable readers, generation behavior, and source provenance. Read only the selected run's files. Kumo is already present; if importing it fails, report the unavailable runtime and stop that workflow.
Generation and availability
On supported builds, Trainer.fit(train_table, snapshot=snapshot) automatically requests
gradient scoring, column analysis and sampled subgraphs after successful training when
model_plan.training_job.disable_explain is false. The selected trainer produces test-stage
artifacts. A failure in this post-training step can leave a usable model with missing or
partial explanations.
The shared explainer can limit the number of test batches. Describe coverage as the processed test subset unless the run proves it covered the full test population.
This behavior is source-verified against the Kumo modules listed in the reference's Evidence
section; it is not a claim about every runtime build. Check the actual runtime version, producer code
when available, artifacts, and logs before promising generation. Do not infer support solely
from the existence of disable_explain.
- Column analysis is restricted to supported node-level tasks. It is not a link-prediction column-analysis workflow; forecasting is not in the reviewed producer's column-analysis list.
- Gradient scoring supports more task types, but the shared trainer skips TWO_TOWER link models. The runtime's explainer task list can narrow support further.
- There is no public
kumo.Trainer.explain()ortraining_result.explanationsaccessor in this API. Do not call private trainers or enable prediction-time XAI through invented options. - An inspection request does not authorize another fit. If required files are absent, diagnose the reason first. Generate an additional fit only when the user has requested that run.
Interpret the evidence
Gradient scores rank table-column contributions aggregated across the examples processed by the explainer. The default producer normalizes them across the graph. They are not signed effects, probabilities, percentages of model accuracy, causal effects, or a per-person explanation. Retain the table name when ranking identically named columns. Report the actual coverage and normalization observed; a missing column is not automatically a zero-contribution column.
Column analysis groups values into cohorts per table, column, and graph hop and records population shares, mean predictions, and, when present, mean observed targets. Inspect a class's own series for multiclass/multilabel tasks. Compare prediction and target patterns with their population shares. Small groups and sampled neighborhoods limit interpretation.
prediction_score and target_score summarize between-cohort variation and are normalized
separately by the default producer. Neither is AUROC, an error metric, or the gradient score.
Do not rank these three score families in one list or treat their differences as calibration error.
Use the cohort means for descriptive prediction-versus-target comparisons. A cohort mismatch
is a lead to investigate, not proof of leakage or a causal mechanism.
Return a useful answer
Give the run, task, stage, selected trainer/refit, and exact file paths used; a bounded ranking of table-column gradient scores; and the relevant cohort comparisons with population shares. Distinguish observations, hypotheses, and missing evidence. Do not promise individual prediction explanations from aggregate files; sampled subgraphs cover only the sampled test entities (see the reference's Sampled subgraphs). If only one explanation family is present, analyze that family and state why the other could not be assessed.
Explain that these files live in local scratch and are excluded from the published model bundle.
Keep this task focused on inspection and interpretation; exporting or regenerating results
requires the user's corresponding request. For learning curves, trial comparisons, or aggregate
evaluation metrics, use kumo-training-diagnostics when available.
In this repository27 other files it gives its agents.
- AGENTS.mdAGENTS.md
- docs/development/agents.mdAGENTS.md
- io_utils/fsutil/AGENTS.mdAGENTS.md
- kumo/pquery/AGENTS.mdAGENTS.md
- packages/diskgraph/diskgraph-train-table/AGENTS.mdAGENTS.md
- packages/kumo-pql/AGENTS.mdAGENTS.md
- ui/AGENTS.mdAGENTS.md
- io_utils/fsutil/CLAUDE.mdCLAUDE.md
- kumo/pquery/CLAUDE.mdCLAUDE.md
- packages/kumo-ui-catalog/CLAUDE.mdCLAUDE.md
- ui/CLAUDE.mdCLAUDE.md
- kumoai-referenceSkill
- kumo-custom-populationsSkill
- kumo-data-scienceSkill
- kumo-model-persistenceSkill
- kumo-model-tuningSkill
- kumo-training-diagnosticsSkill
- build-uiSkill
- check-logsSkill
- code-uiSkill
- debug-issueSkill
- investigate-training-stageSkill
- preflightSkill
- review-mlSkill
- review-uiSkill
- code-ui-catalogSkill
- review-ui-catalogSkill
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
Reviews can't be read right now.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

