publish
Skill6.7k starsChanged 24 days agoApache-2.0View on GitHub
Publish a Harbor task or dataset to the registry. Use when the user wants to upload, publish, or share tasks or datasets/benchmarks on the Harbor registry.
We split this skill into the rules it gives an agent
6 rules. 0 are common, 1 is distinctive, and 5 are very specific to this project.
0
Common
Most of the 43 edited versions we read keep these.
1
Distinctive
This author's own choices. Worth a look.
5
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Very specific: line 8
All commands use uvx harbor so the user does not need to install the CLI globally.
- Very specific: line 12
Auth: Ensure the user is logged in by running uvx harbor auth status.
- Very specific: line 14
Task identifiers: All tasks must have a [task] section in their task.toml with a name like <org>/<name>.
- Very specific: line 45
Add --with-metric if the user needs a custom metric script.
- Very specific: line 47
Auto-add behavior: If dataset init is run in a directory that already contains tasks, those tasks are automatically added to the manifest.
- Distinctive: line 93
Run a published dataset with:
“Common” is measured: kept by at least 6 in 10 of the 43 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Help the user publish a Harbor task or dataset to the registry. Walk them through each step, checking prerequisites and confirming before running publish commands.
All commands use uvx harbor so the user does not need to install the CLI globally.
Prerequisites
- Auth: Ensure the user is logged in by running
uvx harbor auth status. If not logged in, prompt them to runuvx harbor auth login. - Task identifiers: All tasks must have a
[task]section in theirtask.tomlwith a name like<org>/<name>. If missing, run:
To update all tasks in a directory:uvx harbor task update "<path/to/task>" --org "<org>"uvx harbor task update "<path/to/tasks>" --org "<org>" --scan
Publishing a task
uvx harbor publish "<path/to/task>"Publish multiple tasks or all tasks in a directory:
uvx harbor publish "<path/to/task-a>" "<path/to/task-b>"
uvx harbor publish "<path/to/tasks>"Publishing a dataset
1. Initialize the dataset manifest (if no dataset.toml exists)
uvx harbor dataset init "<org>/<dataset>" \
--description "<description>" \
--author "Jane Doe <jane@example.com>"Add --with-metric if the user needs a custom metric script. If omitted, the dataset uses the default metric (average reward across tasks, with missing values treated as 0).
Auto-add behavior: If dataset init is run in a directory that already contains tasks, those tasks are automatically added to the manifest. After init, ask the user if they want to add additional tasks — either from the Harbor registry or from other local folders.
2. Add additional tasks and files (optional)
cd "<path/to/dataset>"
uvx harbor dataset add "<path/to/task-a>" "<path/to/task-b>" # local tasks from elsewhere
uvx harbor dataset add "<path/to/folder>" --scan # all tasks in another folder
uvx harbor dataset add org/task-name # published tasks from registry
uvx harbor dataset add org/dataset-name # all tasks from a published dataset
uvx harbor dataset add metric.py # metric file (same dir as dataset.toml)
uvx harbor dataset remove "<org>/<task-name>" # remove a taskSpecific versions: org/task@tag, org/task@revision, or org/task@sha256:<hash>.
3. Sync digests (if tasks/metrics changed since last publish)
uvx harbor sync
uvx harbor sync --upgrade # also upgrade remote tasks to latest4. Publish the dataset
uvx harbor publish "<path/to/dataset>"uvx harbor publish automatically refreshes digests of local tasks in the dataset directory.
Publish options (tasks and datasets)
-t / --tag: add tags (repeatable).latestis always included.-c / --concurrency: control upload concurrency.--public: make public (private by default).--no-tasks(datasets only): skip publishing tasks in the dataset directory.
Example:
uvx harbor publish "<path>" -t v1.0 --publicAfter publishing
- Visibility can be changed later with
uvx harbor task visibility/uvx harbor dataset visibilityor on https://hub.harborframework.com/. - Run a published dataset with:
uvx harbor run -d "<org>/<dataset>@v1.0" -a "<agent>" -m "<model>"
Trending
Surging: 1 new project took it in the last 4 weeks, none the 4 weeks before.thin data
Who's talking about laude-institute/harbor
- A Hacker News story“Harbor – a framework for evaluating and optimizing agents and language models”Hacker News · Nov 8, 2025 · 3 points
- harbor-framework/harbor“Multiple reward keys not supported”GitHub · Feb 16, 2026 · 2 reactions
- NovaSky-AI/SkyRL“[skyrl-train][Harbor] Upstream Harbor training code to main skyrl-train”GitHub · Jan 12, 2026 · 2 reactions
- harbor-framework/harbor-datasets“Add SpreadsheetBench dataset (400 tasks)”GitHub · Feb 22, 2026 · 1 reactions
- harbor-framework/harbor“why import environment variables in environment.env in examples/configs/*.yaml”GitHub · Jan 12, 2026 · 1 reactions
The biggest 5 of 38 mentions linking to the repository that our crawl found. Each line is their own headline.
See all 38
Talked about on GitHub and Hacker News (38 times).
On GitHub · 37
- Feb 16, 2026Multiple reward keys not supported — harbor-framework/harbor2 reactions · 1 comment
- Jan 12, 2026[skyrl-train][Harbor] Upstream Harbor training code to main skyrl-train — NovaSky-AI/SkyRL2 reactions · 1 comment
- Feb 22, 2026Add SpreadsheetBench dataset (400 tasks) — harbor-framework/harbor-datasets1 reaction
- Jan 12, 2026why import environment variables in environment.env in examples/configs/*.yaml — harbor-framework/harbor1 reaction · 5 comments
- Nov 30, 2025Add Claude Code OAuth authentication documentation — harbor-framework/harbor-docs1 reaction · 1 comment
32 more on GitHub
- Oct 5, 2026Scout pitch: Resumable, seeded benchmark runs (per-item result files, resume flag, recorded seed) — 8gi-foundation/8gent-codesays it tested it0 reactions
- Sep 26, 2026Research input for 13/14 (souls, continuity, retention): reuse existing formats, and make "forget" cascade through derived memory — BharathChinthallapalli/Test-Waters0 reactions
- Sep 15, 2026Nothing measures whether our own skills help, so every subtraction decision is a vibe check — pmgledhill102/agentic-coding-config0 reactions · 1 comment
- Aug 15, 2026Eval infrastructure: measure whether a skill rewrite still routes — Lancetnik/slop-writer0 reactions
- Aug 7, 2026docs: per-plugin CLAUDE.md with the upstream docs and local specifics — walkerhughes/agents0 reactions
- Apr 29, 2026实验记录:Qwen3-8B run-3 (msp60ius) Phase 1 OOD 跑分 — base+4 ckpt × 66 task × 3 attempts (terminus-2 + harbor + sglang) — iter215 OOD 峰 vs iter279 回落 — HansBug/OpenClaw-RL0 reactions
- Apr 10, 2026Feature: Integrate PraisonAI Agents with Terminal-Bench 2.0 (Harbor Framework) — MervinPraison/PraisonAI0 reactions · 1 comment
- Mar 1, 2026Bedrock API key env var mismatch with LiteLLM (`AWS_BEARER_TOKEN_BEDROCK`) — harbor-framework/harbor0 reactions
- Feb 21, 2026[Harbor] Proper cleanup of Trials (especially address sandbox leakage) upon RL run fails / KeyboardInterrupt — NovaSky-AI/SkyRL0 reactions
- Feb 17, 2026[Ready For Review] multi-step checkpoint trial execution — harbor-framework/harbor0 reactions · 1 comment
- Feb 16, 2026Change asyncio.gather to TaskGroup in the Harbor generator to correctly propagate cancellation signals. — NovaSky-AI/SkyRL0 reactions · 6 comments
- Feb 12, 2026Sandboxes do not get terminated after Keyboard interruption during RL — harbor-framework/harbor0 reactions · 3 comments
- Feb 12, 2026Improve startup time with installed agents — harbor-framework/harbor0 reactions · 2 comments
- Feb 11, 2026Support MCP for all agents — harbor-framework/harbor0 reactions · 2 comments
- Feb 9, 2026Stored Object: paper:url.153C303C — chtmp223/papers-feed0 reactions · 1 comment
- Feb 5, 2026Bug: breaking change from `bash -ic` to `bash -lc` — harbor-framework/harbor0 reactions · 1 comment
- Feb 5, 2026TMUX is not compatible with the alpine image in docker — harbor-framework/harbor0 reactions · 1 comment
- Jan 20, 2026OpenRouter model names not working in Harbor 0.1.42 (`--model openrouter/anthropic/claude-sonnet-4.5`) — harbor-framework/harbor0 reactions
- Jan 17, 2026Failures in agent setup are silently discarded — harbor-framework/harbor0 reactions
- Jan 16, 2026Terminus 2 Agent Uses Logger Before Initialization When Model Provider is hosted_vllm — harbor-framework/harbor0 reactions · 1 comment
- Jan 10, 2026feat: Support Agent-Trajectory Interchange Format (ATIF) for trial trajectory capture — spachava753/rollout0 reactions
- Jan 10, 2026feat(evaluation): block web access and restrict LiteLLM tools during CRS run phase — sslab-gatech/CRSBench0 reactions · 4 comments
- Jan 6, 2026docker gpu support — harbor-framework/harbor0 reactions · 11 comments
- Dec 28, 2025BUG: where does 4096 come from? — harbor-framework/harbor0 reactions · 1 comment
- Dec 24, 2025Fix: Docker environment PATH inheritance on macOS — rotemtam/harbor0 reactions
- Dec 23, 2025Adapter runs unable to find docker — harbor-framework/harbor0 reactions · 2 comments
- Dec 17, 2025Trajectory viewer for non-linear history — harbor-framework/harbor0 reactions · 2 comments
- Dec 16, 2025environment.exec(): bash: cannot set terminal process group (-1): Not a tty bash: no job control in this shell — harbor-framework/harbor0 reactions · 3 comments
- Dec 16, 2025Deniz/dc agent updates 1215 — mlfoundations/SkyRL0 reactions
- Dec 10, 2025🚨 CRITICAL: Docker Compose project name validation bug breaks Oracle on custom_docker_compose tasks — harbor-framework/harbor0 reactions · 2 comments
- Nov 30, 2025Revert litellm hack once upstream fix is released — harbor-framework/harbor0 reactions · 2 comments
- Nov 24, 2025Feature Request: Harbor as a LLM proxy — harbor-framework/harbor0 reactions · 1 comment
On Hacker News · 1
Other versions55 projects use a version of this.
Word for word · 1
- harbor-framework/harbor★ 6.2k100% same
Edited · 0
None found.
Wrote their own version · 54
- code-yeongyu/oh-my-openagent★ 71ksame name
- code-yeongyu/oh-my-opencode★ 71ksame name
- garrytan/gbrain★ 31ksame name
- TencentCloud/Octop★ 11ksame name
- Q00/ouroboros★ 6.3ksame name
- paean-ai/deeptide★ 1.1ksame name
- ZimoLiao/scholaraio★ 577same name
- agent-tower/core★ 404same name
- ansvisor/ansvisor★ 220same name
- tomaspavlin/rohlik-mcp★ 119same name
44 more not listed
How matches are found. Word for word: the exact same text. Edited: shares passages with this file (“99% same” means 99% of its five-word phrases also appear here; 10% or more counts). Their own version: similar meaning, or, weakest, the same name. We can’t tell which project had it first. Projects are counted among the 200 most-starred candidates, and mentions are links to the repository we found, up to 50 per site, so both counts are a floor.
Used alongsideProjects with it also use render, ingest and 4 more.
Other files people use alongside this one.
Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
suxrobGMSkillrender
Generate raster images (PNG, JPEG, WebP) from natural language prompts using Python rendering engines. Covers graphics, charts, layouts, and procedural art. Not for SVG output.
Also in 3 projects that use this
JaimeGBASkillingest
Digest an external source (article, paper, transcript, URL, book chapter) and integrate its content into the knowledge base
Also in 5 projects that use this
genomewalkerSkillexplore
RLM-style recursive memory exploration - dynamically navigate the memory graph
Also in 3 projects that use this
VercelSkillsetup
Set up Vercel CLI and project configuration. Use when the user says "set up Vercel", "configure Vercel", "link to Vercel", or "vercel init".
Also in 12 projects that use this
kt057Skillcheck
lint, typecheck, test を一括実行して結果をサマリーする
Also in 3 projects that use this
AnthropicSkillstatus
Case status summary by audience — client-facing (plain language), internal (for the professor), or court-ready (formal caption format per local rules). Same facts, different framing and depth. Use when a student needs to update the client, brief the professor, or prepare a court status report.
Also in 3 projects that use this
In this repository7 other files it gives its agents.
- AGENTS.mdAGENTS.md
- docs/AGENTS.mdAGENTS.md
- create-adapterSkill
- create-taskSkill
- harbor-execSkill
- rewardkitSkill
- upload-parity-experimentsSkill
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
Reviews can't be read right now.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

