modelscope-datasets
Skill4 starsChanged 8 months agoApache-2.0View on GitHub
Build, clean, validate, and publish ModelScope datasets from plain-language instructions with automatic template selection.
In this repository15 other files it gives its agents.
- agents/AGENTS.mdAGENTS.md
- modelscope-cliSkill
- modelscope-dataset-explorerSkill
- modelscope-evaluationSkill
- gradioSkill
- modelscope-jobsSkill
- modelscope-local-trainerSkill
- modelscope-local-vision-trainerSkill
- modelscope-mcpSkill
- modelscope-model-trainerSkill
- modelscope-paper-publisherSkill
- modelscope-tool-builderSkill
- modelscope-trackingSkill
- modelscope-vision-trainerSkill
- transformers-jsSkill
The file
We split this skill into the rules it gives an agent
11 rules. About 0 are common, 8 are distinctive, and 3 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈8
Distinctive · estimate
This author's own choices. Worth a look.
3
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 8
Use this skill when the user wants to create or curate a dataset and describes the requirement in natural language.
- Distinctive: line 16
Default to the closest of:
- Distinctive: line 35
Run SQL-based inspection only after a stable snapshot exists.
- Very specific: line 40
If split names are missing, prefer train, validation, test.
- Very specific: line 41
If schema is ambiguous, preserve raw columns and choose custom instead of forcing the wrong template.
- Distinctive: line 42
If metadata is missing, keep placeholders separate from row data.
- Very specific: line 53
Use MODELSCOPE_API_TOKEN or a prior modelscope login session for publish steps.
- Distinctive: line 57
Never force the user into a verbose dataset-writing template.
- Distinctive: line 58
Never upload private or unlicensed data by default.
- Distinctive: line 59
Never mutate rows before validating the intended schema.
- Distinctive: line 60
Keep raw and normalized outputs separate.
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
ModelScope Datasets
Use this skill when the user wants to create or curate a dataset and describes the requirement in natural language.
Request Style
- Accept requests like:
Create a chat dataset repo from these JSONL files.把这个问答数据整理成标准 QA 数据集并上传到 ModelScope。
- Infer the nearest supported template instead of demanding a template upfront.
- Default to the closest of:
chatclassificationqacompletiontabularcustom
Primary Scripts
scripts/dataset_manager.pyscripts/sql_manager.py
Workflow
- Infer dataset type from the user request and existing files.
- Initialize or reuse the target dataset repo.
- Normalize rows to the nearest template.
- Validate before upload.
- Run SQL-based inspection only after a stable snapshot exists.
- Publish only the processed dataset, not accidental raw byproducts.
Defaults
- If split names are missing, prefer
train,validation,test. - If schema is ambiguous, preserve raw columns and choose
custominstead of forcing the wrong template. - If metadata is missing, keep placeholders separate from row data.
Assets
- Templates live in
templates/. - Example rows live in
examples/.
Load only the template or example that matches the current request.
Authentication
Use MODELSCOPE_API_TOKEN or a prior modelscope login session for publish steps.
Guardrails
- Never force the user into a verbose dataset-writing template.
- Never upload private or unlicensed data by default.
- Never mutate rows before validating the intended schema.
- Keep raw and normalized outputs separate.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

