agentleFS
NVIDIAKnown publisherNVIDIA/kumo-engine/agent-skills/skills/kumo-model-explanations/SKILL.md

kumo-model-explanations

Skill34 starsChanged 23 days agoApache-2.0View on GitHub

Inspect and interpret gradient attribution (including requests called radiant attribution), column analysis and sampled explanation subgraphs from a Kumo model trained in a Python notebook. Locate the correct run's explanation artifacts, explain feature scores and cohorts, and identify missing or unsupported explanations without automatically retraining.

We split this skill into the rules it gives an agent

6 rules. About 0 are common, 5 are distinctive, and 1 is very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈5

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 1

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Use this skill for questions such as “which columns influenced this model?”, “show gradient attribution”, or “compare predictions and …

    line 8
  2. Distinctive:

    If several runs or trainer/refit directories exist, list candidates and resolve which one the user means.

    line 19
  3. Distinctive:

    Read the artifact workflow for discovery, executable readers, generation behavior, and source provenance.

    line 24
  4. Distinctive:

    Do not rank these three score families in one list or treat their differences as calibration error.

    line 68
  5. Distinctive:

    Use the cohort means for descriptive prediction-versus-target comparisons.

    line 69
  6. Very specific:

    Keep this task focused on inspection and interpretation.

    line 82

≈ “Common” is an estimate: at least 1 in 5 of the 308,232 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Kumo model explanations

Use this skill for questions such as “which columns influenced this model?”, “show gradient attribution”, or “compare predictions and observed outcomes by column cohort”. Kumo calls the method gradient attribution/scoring, not Radiant. Work in the existing Snowflake notebook with its in-process kumo.engine runtime and retained local run files.

Establish the run and question

  • Reuse the user's task, model, graph, and run identity. Do not restart training intake.
  • For a fresh training_result, Path(training_result.bundle_dir).parent identifies that fit's run directory in the reviewed implementation. Otherwise use the retained run directory the user supplied. A downloaded model bundle is not the original training run.
  • If several runs or trainer/refit directories exist, list candidates and resolve which one the user means. Never silently select the newest directory or combine different runs.
  • Identify the task type, target/positive class, explanation stage, and fit/refit used. Record unknowns explicitly. These determine what the scores can mean.

Read the artifact workflow for discovery, executable readers, generation behavior, and source provenance. Read only the selected run's files. Kumo is already present; if importing it fails, report the unavailable runtime and stop that workflow.

Generation and availability

On supported builds, Trainer.fit(train_table, snapshot=snapshot) automatically requests gradient scoring, column analysis and sampled subgraphs after successful training when model_plan.training_job.disable_explain is false. The selected trainer produces test-stage artifacts. A failure in this post-training step can leave a usable model with missing or partial explanations.

The shared explainer can limit the number of test batches. Describe coverage as the processed test subset unless the run proves it covered the full test population.

This behavior is source-verified against the Kumo modules listed in the reference's Evidence section; it is not a claim about every runtime build. Check the actual runtime version, producer code when available, artifacts, and logs before promising generation. Do not infer support solely from the existence of disable_explain.

  • Column analysis is restricted to supported node-level tasks. It is not a link-prediction column-analysis workflow; forecasting is not in the reviewed producer's column-analysis list.
  • Gradient scoring supports more task types, but the shared trainer skips TWO_TOWER link models. The runtime's explainer task list can narrow support further.
  • There is no public kumo.Trainer.explain() or training_result.explanations accessor in this API. Do not call private trainers or enable prediction-time XAI through invented options.
  • An inspection request does not authorize another fit. If required files are absent, diagnose the reason first. Generate an additional fit only when the user has requested that run.

Interpret the evidence

Gradient scores rank table-column contributions aggregated across the examples processed by the explainer. The default producer normalizes them across the graph. They are not signed effects, probabilities, percentages of model accuracy, causal effects, or a per-person explanation. Retain the table name when ranking identically named columns. Report the actual coverage and normalization observed; a missing column is not automatically a zero-contribution column.

Column analysis groups values into cohorts per table, column, and graph hop and records population shares, mean predictions, and, when present, mean observed targets. Inspect a class's own series for multiclass/multilabel tasks. Compare prediction and target patterns with their population shares. Small groups and sampled neighborhoods limit interpretation.

prediction_score and target_score summarize between-cohort variation and are normalized separately by the default producer. Neither is AUROC, an error metric, or the gradient score. Do not rank these three score families in one list or treat their differences as calibration error. Use the cohort means for descriptive prediction-versus-target comparisons. A cohort mismatch is a lead to investigate, not proof of leakage or a causal mechanism.

Return a useful answer

Give the run, task, stage, selected trainer/refit, and exact file paths used; a bounded ranking of table-column gradient scores; and the relevant cohort comparisons with population shares. Distinguish observations, hypotheses, and missing evidence. Do not promise individual prediction explanations from aggregate files; sampled subgraphs cover only the sampled test entities (see the reference's Sampled subgraphs). If only one explanation family is present, analyze that family and state why the other could not be assessed.

Explain that these files live in local scratch and are excluded from the published model bundle. Keep this task focused on inspection and interpretation; exporting or regenerating results requires the user's corresponding request. For learning curves, trial comparisons, or aggregate evaluation metrics, use kumo-training-diagnostics when available.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

Reviews can't be read right now.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.