getitune-preparing-datasets
Skill1.4k starsChanged 17 days agoApache-2.0View on GitHub
Prepare and point datasets at the getitune library (the Geti training library) for training, testing, and prediction. Use when a user asks which dataset formats are supported, how the `data=` argument of `create_engine(...)` / `--data_root` works, why format auto-detection fails, how to lay out COCO/YOLO/Pascal VOC/Datumaro-native data, how to use a zip archive, or how to pass an Ultralytics YOLO `data.yaml`. Covers Datumaro-based auto-detection and per-task data expectations.
2 other projects use a version of this.
Adopted by
Steady: 0 new projects took it in the last 4 weeks, none the 4 weeks before.thin data
Most recently taken up by
- open-edge-platform/skillsword for word, first seen Nov 8, 2026
- open-edge-platform/training_extensionsword for word, first seen Nov 2, 2026
Who's talking about open-edge-platform/geti
- A Hacker News story“Intel Geti is available on GitHub”Hacker News · May 8, 2025 · 3 points
- @tom-doerr.bsky.social“https://github.com/open-edge-platform/geti”Bluesky · Mar 19, 2026 · 2 likes
- A Hacker News story“Intel Geti and Intel Geti SDK are open-source”Hacker News · May 27, 2025 · 2 points
- sudosubin/agents.nix“agent-skills.github.open-edge-platform.geti: 0-unstable-2026-10-30 → 0-unstable-2026-11-04”GitHub · Nov 4, 2026
- intel/skills“chore: add Geti skills”GitHub · Nov 3, 2026
The biggest 5 of 24 mentions linking to the repository that our crawl found. Each line is their own headline.
See all 24
Talked about on GitHub, Hacker News and Bluesky (24 times).
On GitHub · 21
- Nov 4, 2026agent-skills.github.open-edge-platform.geti: 0-unstable-2026-10-30 → 0-unstable-2026-11-04 — sudosubin/agents.nix0 reactions
- Nov 3, 2026chore: add Geti skills — intel/skills0 reactions
- Oct 30, 2026agent-skills.github.open-edge-platform.geti: 0-unstable-2026-10-27 → 0-unstable-2026-10-30 — sudosubin/agents.nix0 reactions
- Oct 27, 2026agent-skills.github.open-edge-platform.geti: 0-unstable-2026-10-20 → 0-unstable-2026-10-27 — sudosubin/agents.nix0 reactions
- Oct 22, 2026Migrate export_pretrained_models.py from Geti to Model API — open-edge-platform/model_api0 reactions
16 more on GitHub
- Oct 20, 2026agent-skills.github.open-edge-platform.geti: 0-unstable-2026-08-25 → 0-unstable-2026-10-20 — sudosubin/agents.nix0 reactions
- Oct 3, 2026agent-skills.github.open-edge-platform.geti: 0.3.0 → 0-unstable-2026-08-25 — sudosubin/agents.nix0 reactions
- Sep 30, 2026agent-skills.github.open-edge-platform.geti: init at 0.3.0 — sudosubin/agents.nix0 reactions
- Sep 17, 2026Bump tools/geti from `9d449de` to `2861019` — vkb1/edge-ai-libraries0 reactions · 1 comment
- Sep 17, 2026Bump libraries/training_extensions from `9d449de` to `2861019` — vkb1/edge-ai-libraries0 reactions · 1 comment
- Sep 16, 2026Bump tools/geti from `9d449de` to `b54f204` — vkb1/edge-ai-libraries0 reactions · 1 comment
- Sep 7, 2026Fix name collision issue with COCO/YOLO datasets — open-edge-platform/datumaro0 reactions · 1 comment
- Sep 1, 2026Re-upload models to HF with a dynamic batch size — open-edge-platform/model_api0 reactions · 1 comment
- Aug 11, 2026fix: Modify cleanup-images action to keep underlying RC untagged images — open-edge-platform/geti-ci0 reactions
- Aug 6, 2026fix(smart-tools): Add SAM fixes — MarkRedeman/geti-ui0 reactions · 1 comment
- Aug 5, 2026Extend visualization to support label colours — open-edge-platform/model_api0 reactions
- Aug 3, 2026Configurable confidence threshold on inference request — open-edge-platform/model_api0 reactions
- Jul 27, 2026chore: release main — MarkRedeman/geti-ui0 reactions · 2 comments
- Jul 15, 2026Cannot go past the license check when starting backend on Windows — open-edge-platform/geti-instant-learn0 reactions · 1 comment
- Jun 29, 2026Add `cleanup-images` as a composite action and enable it across repos — open-edge-platform/geti-ci0 reactions · 5 comments
- Jul 22, 2025Remove OVMS inference code — open-edge-platform/geti-sdk0 reactions
On Hacker News · 2
- May 8, 2025Intel Geti is available on GitHub3 points · 1 comment
- May 27, 2025Intel Geti and Intel Geti SDK are open-source2 points · 1 comment
On Bluesky · 1
- Mar 19, 2026https://github.com/open-edge-platform/geti — @tom-doerr.bsky.social2 likes and reposts · 1 reply
Other versions2 projects use a version of this.
Word for word · 2
- open-edge-platform/training_extensions★ 1.4k100% same
- open-edge-platform/skills★ 8100% same
Edited · 0
None found.
Wrote their own version · 0
None found.
How matches are found. Word for word: the exact same text. Edited: shares passages with this file (“99% same” means 99% of its five-word phrases also appear here; 10% or more counts). Their own version: similar meaning, or, weakest, the same name. We can’t tell which project had it first. Projects are counted among the 200 most-starred candidates, and mentions are links to the repository we found, up to 50 per site, so both counts are a floor.
In this repository18 other files it gives its agents.
- AGENTS.mdAGENTS.md
- CLAUDE.mdCLAUDE.md
- .github/copilot-instructions.mdCopilot instructions
- geti-annotating-and-managing-labelsSkill
- geti-backend-devSkill
- geti-docs-updateSkill
- geti-import-export-datasetsSkill
- geti-openapi-syncSkill
- geti-runtime-configuring-inference-pipelineSkill
- geti-runtime-running-live-inferenceSkill
- geti-ui-devSkill
- geti-using-the-pipelineSkill
- geti-library-devSkill
- getitune-discovering-modelsSkill
- getitune-exporting-a-modelSkill
- getitune-optimizing-a-modelSkill
- getitune-running-inferenceSkill
- getitune-training-a-modelSkill
The file
We split this skill into the rules it gives an agent
3 rules. About 0 are common, 0 are distinctive, and 3 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈0
Distinctive · estimate
This author's own choices. Worth a look.
3
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Very specific: line 8
When you pass a filesystem path to data= (Python API) or --data_root (CLI), getitune uses Datumaro to
- Very specific: line 13
Run everything from libraries/getitune/.
- Very specific: line 56
If you train an Ultralytics YOLO model, pass the Ultralytics data.yaml file directly as data= (or --data_root).
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Preparing datasets for getitune
When you pass a filesystem path to data= (Python API) or --data_root (CLI),
getitune uses Datumaro to
auto-detect the dataset format — you point at the dataset root and the same
call works regardless of the underlying format.
Run everything from libraries/getitune/.
Supported formats and how they are detected
| Format | Detected by |
| COCO | an annotations/ directory with COCO JSON files |
| YOLO | a data.yaml file (Ultralytics layout) |
| Pascal VOC | JPEGImages/, Annotations/, ImageSets/ directories |
| Datumaro (native) | metadata.json + data.parquet at the root |
- Zip archives are accepted too; Datumaro extracts them on import.
- Point
data=at the dataset root — the directory that directly contains the marker files/folders above, not a parent of it.
Workflow
from getitune.engine import create_engine
# Same call for any supported format — just point at the root
engine = create_engine(
model="src/getitune/recipe/detection/yolox_s.yaml",
data="/path/to/dataset_root",
)
engine.train()- Lay the dataset out as one supported format and confirm the marker
files/folders sit at the root you will pass.
- Done when: the root matches exactly one row in the table above.
- Match the dataset to the task. A detection dataset needs bounding-box
annotations; segmentation needs masks; classification needs per-image labels.
Task and labels must agree with the model you choose in the
getitune-training-a-modelskill.- Done when:
create_engine(...)builds a datamodule without a feature/label mismatch error.
- Done when:
- Smoke-test loading with a tiny run (
engine.train(max_epochs=1)) before a full run.- Done when: one train + one validation batch load without shape errors.
Ultralytics YOLO datasets
If you train an Ultralytics YOLO model, pass the Ultralytics
data.yaml file directly as data=
(or --data_root). Ultralytics support requires an install from source with the
ultralytics extra (it is not in the PyPI package).
Debugging auto-detection
- Wrong/failed format detection: the root probably has extra nesting or a
missing marker. Verify the exact marker files (
annotations/for COCO,data.yamlfor YOLO, the three VOC dirs,metadata.json+data.parquetfor native) are directly under the path you pass. - Feature/label mismatch during training: the dataset's annotation type does
not match the task — cross-check with
getitune-training-a-modeland pass an explicittask=. - Backend dataset conversion: the Geti application converts Geti-internal
datasets to/from COCO/VOC via
application/backend/app/datumaro_converter/; that is a separate, app-side path from librarydata=usage.
Related skills
getitune-training-a-model— consumes the prepared dataset viadata=.getitune-discovering-models— pick a model that matches the dataset's task.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

