skippy-model-package

Use this skill for model inspection, package planning, stage materialization, and cache behavior.

Ownership

Rust owns package manifests, topology planning inputs, cache policy, and mesh model-storage integration. The patched llama/skippy ABI owns GGUF tensor inspection and GGUF artifact writing.

The native package ABI is declared in include/skippy/model_package.h and implemented in src/skippy/model_package.cpp. Keep model inspection, tensor filtering, metadata copying, and package writing in that module; do not grow src/skippy.cpp with package behavior.

Direct GGUF loading in mesh should materialize as a fake package identity in the skippy runtime so the split-serving path can use the same package-backed stage machinery as Hugging Face packages.

Commands

Check current package names before running commands:

just with-lld cargo metadata --no-deps --format-version 1 | jq -r '.packages[].name' | sort

Useful current checks in this repo:

just with-lld cargo test -p skippy-runtime --lib
just with-lld cargo test -p skippy-topology --lib
just with-lld cargo test -p mesh-llm-host-runtime --lib inference::skippy

For a published layer package, prefer package-local diagnostics before a live split smoke. On macOS or Linux, just release-runtime-build cpu builds the skippy-package-builder Cargo binary and packages it with its native libraries. Replace <runtime-id> with the generated directory under dist/native-runtimes:

just with-lld cargo test -p skippy-package-builder --bin skippy-package-builder
just release-runtime-build cpu
package_builder="dist/native-runtimes/<runtime-id>/tools/skippy-package-builder"
"$package_builder" preflight <package-dir> --stages 2

Cache Policy

Materialized stages are derived cache. Model storage commands may evict materialized stage artifacts without deleting the source model/package. Preserve pinned materialized artifacts unless the command explicitly asks for a stronger cleanup.