getitune-preparing-datasets
Skill1.4k starsChanged 17 days agoApache-2.0View on GitHub
Prepare and point datasets at the getitune library (the Geti training library) for training, testing, and prediction. Use when a user asks which dataset formats are supported, how the `data=` argument of `create_engine(...)` / `--data_root` works, why format auto-detection fails, how to lay out COCO/YOLO/Pascal VOC/Datumaro-native data, how to use a zip archive, or how to pass an Ultralytics YOLO `data.yaml`. Covers Datumaro-based auto-detection and per-task data expectations.
2 other projects use a version of this.
Adopted by
Steady: 0 new projects took it in the last 4 weeks, none the 4 weeks before.thin data
Most recently taken up by
- open-edge-platform/skillsword for word, first seen Nov 8, 2026
- open-edge-platform/getiword for word, first seen Nov 2, 2026
Who's talking about open-edge-platform/training_extensions
- open-edge-platform/geti“Serve tiff media as png”GitHub · Oct 29, 2026 · 1 reactions
- open-edge-platform/geti“Update licensing logic & content”GitHub · Oct 6, 2026 · 1 reactions
- open-edge-platform/geti“Resumable TUS uploads”GitHub · Oct 5, 2026 · 1 reactions
- open-edge-platform/geti“chore: Verify that other languages follows english translation keys”GitHub · Oct 2, 2026 · 1 reactions
- open-edge-platform/geti“Update projects page layout”GitHub · Sep 18, 2026 · 1 reactions
The biggest 5 of 50 mentions linking to the repository that our crawl found. Each line is their own headline.
See all 50
Talked about on GitHub (50 times).
On GitHub · 50
- Oct 29, 2026Serve tiff media as png — open-edge-platform/geti1 reaction · 3 comments
- Oct 6, 2026Update licensing logic & content — open-edge-platform/geti1 reaction · 3 comments
- Oct 5, 2026Resumable TUS uploads — open-edge-platform/geti1 reaction · 3 comments
- Oct 2, 2026chore: Verify that other languages follows english translation keys — open-edge-platform/geti1 reaction · 2 comments
- Sep 18, 2026Update projects page layout — open-edge-platform/geti1 reaction · 3 comments
45 more on GitHub
- Sep 15, 2026Drop 2 custom hooks in favor of usehook-ts native ones — open-edge-platform/geti1 reaction · 2 comments
- Sep 15, 2026Drop uuid package in favor of native crypto package — open-edge-platform/geti1 reaction · 2 comments
- Sep 2, 2026Show media skeleton while scrolling — open-edge-platform/geti1 reaction · 2 comments
- Aug 28, 2026Remove onnx encoder file from the build — open-edge-platform/geti1 reaction · 3 comments
- Aug 27, 2026[Language support] add Chinese (zh-CN/HK/MO/TW) UI support - PART 2 — open-edge-platform/geti1 reaction · 13 comments
- Aug 21, 2026Fix segmentation contour label offset — open-edge-platform/geti1 reaction · 3 comments
- Jul 31, 2026Failed jobs visualisation — open-edge-platform/geti1 reaction · 4 comments
- Jul 23, 2026Remove H-CLS and Rotated Det — open-edge-platform/geti1 reaction · 4 comments
- Jun 29, 2026Add EdgeCrafter Model — open-edge-platform/geti1 reaction · 9 comments
- Jun 5, 2026Update numberfield visualisation — open-edge-platform/geti1 reaction · 2 comments
- Jun 4, 2026Add 3 dots flashing for dataset import dialogs — open-edge-platform/geti1 reaction · 2 comments
- May 17, 2026Fix flaky BDD test - export cls dataset — open-edge-platform/geti1 reaction
- May 15, 2026fix: Consistent size of metric graphs — open-edge-platform/geti1 reaction · 2 comments
- Apr 29, 2026Change primary metric to mAP@0.5 for detection / segmentation — open-edge-platform/geti1 reaction
- Apr 29, 2026Add ONNX model support to OVEngine for test/predict — open-edge-platform/geti1 reaction · 2 comments
- Apr 29, 2026feat: Show deleted weights badge when model's weights are deleted — open-edge-platform/geti1 reaction · 2 comments
- Apr 24, 2026feat: Upload date filter — open-edge-platform/geti1 reaction · 7 comments
- Apr 22, 2026Move unit tests to overflow runner — open-edge-platform/geti1 reaction · 3 comments
- Apr 16, 2026Fix layout issues on train model dialog — open-edge-platform/geti1 reaction · 2 comments
- Apr 13, 2026BMG card not detected in Docker container: extra_render_args limited to first XPU — open-edge-platform/geti1 reaction · 1 comment
- Mar 26, 2026fix: Display placeholder when project thumbnail is not available — open-edge-platform/geti1 reaction · 2 comments
- Mar 18, 2026feat(training configuration): Add learning parameters [PART 12] — open-edge-platform/geti1 reaction · 2 comments
- Feb 17, 2026fix: SAM tool, dataset revision created at, models page — open-edge-platform/geti1 reaction · 2 comments
- Feb 5, 2026chore: Improve models screen [PART 1] — open-edge-platform/geti1 reaction · 3 comments
- Jan 29, 2026Renovate config update — open-edge-platform/anomalib1 reaction · 1 comment
- Jan 27, 2026Set multiprocessing method in OTXDataModule — open-edge-platform/geti1 reaction · 1 comment
- Jan 20, 2026Cleanup unnecessary OTX entities — open-edge-platform/geti1 reaction · 1 comment
- Jan 19, 2026feat(models): Model training flow — open-edge-platform/geti1 reaction · 2 comments
- Dec 13, 2025Add RFDetr model for Object Detection and Instance Segmentation — open-edge-platform/geti1 reaction · 5 comments
- Oct 24, 2025Refactoring: Event Bus & services decoupling — open-edge-platform/geti1 reaction · 2 comments
- Oct 20, 2025Integrate model statistics — open-edge-platform/geti1 reaction · 2 comments
- Oct 16, 2025Hide/focus annotations — open-edge-platform/geti1 reaction · 2 comments
- Aug 27, 2025Classification Dataset refactor — open-edge-platform/geti1 reaction · 1 comment
- Jun 13, 2025Inconsistent license headers + docstrings — open-edge-platform/geti1 reaction · 1 comment
- Apr 14, 2025🔧 Update Python version to 3.12 across workflow files and configuration — open-edge-platform/geti1 reaction
- Nov 6, 2026Take drawing tool bounds from the media ROI instead of the image — open-edge-platform/geti0 reactions · 2 comments
- Nov 6, 2026Refactor magnetic lasso tests — open-edge-platform/geti0 reactions · 2 comments
- Nov 5, 2026Cleanup deprecated fields from previous api extension — open-edge-platform/geti0 reactions · 3 comments
- Nov 2, 2026Design for OME-TIFF support on the backend (OME-Zarr ready) — open-edge-platform/geti0 reactions · 4 comments
- Nov 1, 2026test: Verify FMeasure confidence threshold retention — open-edge-platform/geti0 reactions · 2 comments
- Oct 31, 2026feat: Add High-Speed IOU tracker — open-edge-platform/geti0 reactions
- Oct 28, 2026Keep windows desktop logs in Intel\Geti\logs — open-edge-platform/geti0 reactions · 3 comments
- Oct 23, 2026Add translation for Hindi language — open-edge-platform/geti0 reactions · 2 comments
- Oct 23, 2026Add translation for German language — open-edge-platform/geti0 reactions · 2 comments
- Oct 19, 2026docs(assistant): Feature design document for chat assistant — open-edge-platform/geti0 reactions
Other versions2 projects use a version of this.
Word for word · 2
- open-edge-platform/geti★ 1.4k100% same
- open-edge-platform/skills★ 8100% same
Edited · 0
None found.
Wrote their own version · 0
None found.
How matches are found. Word for word: the exact same text. Edited: shares passages with this file (“99% same” means 99% of its five-word phrases also appear here; 10% or more counts). Their own version: similar meaning, or, weakest, the same name. We can’t tell which project had it first. Projects are counted among the 200 most-starred candidates, and mentions are links to the repository we found, up to 50 per site, so both counts are a floor.
In this repository18 other files it gives its agents.
- AGENTS.mdAGENTS.md
- CLAUDE.mdCLAUDE.md
- .github/copilot-instructions.mdCopilot instructions
- geti-annotating-and-managing-labelsSkill
- geti-backend-devSkill
- geti-docs-updateSkill
- geti-import-export-datasetsSkill
- geti-openapi-syncSkill
- geti-runtime-configuring-inference-pipelineSkill
- geti-runtime-running-live-inferenceSkill
- geti-ui-devSkill
- geti-using-the-pipelineSkill
- geti-library-devSkill
- getitune-discovering-modelsSkill
- getitune-exporting-a-modelSkill
- getitune-optimizing-a-modelSkill
- getitune-running-inferenceSkill
- getitune-training-a-modelSkill
The file
We split this skill into the rules it gives an agent
3 rules. About 0 are common, 0 are distinctive, and 3 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈0
Distinctive · estimate
This author's own choices. Worth a look.
3
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Very specific: line 8
When you pass a filesystem path to data= (Python API) or --data_root (CLI), getitune uses Datumaro to
- Very specific: line 13
Run everything from libraries/getitune/.
- Very specific: line 56
If you train an Ultralytics YOLO model, pass the Ultralytics data.yaml file directly as data= (or --data_root).
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Preparing datasets for getitune
When you pass a filesystem path to data= (Python API) or --data_root (CLI),
getitune uses Datumaro to
auto-detect the dataset format — you point at the dataset root and the same
call works regardless of the underlying format.
Run everything from libraries/getitune/.
Supported formats and how they are detected
| Format | Detected by |
| COCO | an annotations/ directory with COCO JSON files |
| YOLO | a data.yaml file (Ultralytics layout) |
| Pascal VOC | JPEGImages/, Annotations/, ImageSets/ directories |
| Datumaro (native) | metadata.json + data.parquet at the root |
- Zip archives are accepted too; Datumaro extracts them on import.
- Point
data=at the dataset root — the directory that directly contains the marker files/folders above, not a parent of it.
Workflow
from getitune.engine import create_engine
# Same call for any supported format — just point at the root
engine = create_engine(
model="src/getitune/recipe/detection/yolox_s.yaml",
data="/path/to/dataset_root",
)
engine.train()- Lay the dataset out as one supported format and confirm the marker
files/folders sit at the root you will pass.
- Done when: the root matches exactly one row in the table above.
- Match the dataset to the task. A detection dataset needs bounding-box
annotations; segmentation needs masks; classification needs per-image labels.
Task and labels must agree with the model you choose in the
getitune-training-a-modelskill.- Done when:
create_engine(...)builds a datamodule without a feature/label mismatch error.
- Done when:
- Smoke-test loading with a tiny run (
engine.train(max_epochs=1)) before a full run.- Done when: one train + one validation batch load without shape errors.
Ultralytics YOLO datasets
If you train an Ultralytics YOLO model, pass the Ultralytics
data.yaml file directly as data=
(or --data_root). Ultralytics support requires an install from source with the
ultralytics extra (it is not in the PyPI package).
Debugging auto-detection
- Wrong/failed format detection: the root probably has extra nesting or a
missing marker. Verify the exact marker files (
annotations/for COCO,data.yamlfor YOLO, the three VOC dirs,metadata.json+data.parquetfor native) are directly under the path you pass. - Feature/label mismatch during training: the dataset's annotation type does
not match the task — cross-check with
getitune-training-a-modeland pass an explicittask=. - Backend dataset conversion: the Geti application converts Geti-internal
datasets to/from COCO/VOC via
application/backend/app/datumaro_converter/; that is a separate, app-side path from librarydata=usage.
Related skills
getitune-training-a-model— consumes the prepared dataset viadata=.getitune-discovering-models— pick a model that matches the dataset's task.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

