organize-experiments

---
name: organize-experiments
description: Harvest experiment issue reports and curate docs/reports/index.md only when explicitly requested.
---

# Skill: Organize Experiment Reports

## Overview
Curate `docs/reports/index.md` after new experiment issues are harvested: fold fresh entries into the right sections, refresh links, and leave `## Uncategorized` empty.

## Prerequisites
- Local checkout of the marin repository with write access.
- Ability to run `uv` commands.
- Familiarity with the existing experiment categories in `docs/reports/index.md`.

## Guidelines for Humans

### Standard Workflow
1. Run `uv run scripts/pm/itemize_experiment_issues.py` to append new experiments.
2. Open the diff for `docs/reports/index.md` and identify the additions in `## Uncategorized`.
3. For each experiment:
   - Match it to an existing section (e.g., `Training and Performance`, `Data Experiments`).
   - Merge new WandB links into the canonical entry in that section.
   - Remove the placeholder entry from `## Uncategorized`.
4. If an experiment truly does not fit, leave it under `## Uncategorized` and add a note explaining why.
5. Proofread for duplicate bullets, broken Markdown, and consistent title casing.
6. Commit the curated report, open a PR, or, if an interactive agent, signal to the user to look.

### Link Hygiene
- Prefer direct `https://wandb.ai/...` links when available; keep legacy `api.wandb.ai` links only if the direct share link does not exist.
- Do not add Data Browser links. The service was retired in [#8624](https://github.com/marin-community/marin/pull/8624); the script collects only WandB URLs.
- Preserve access tokens embedded in links.

## Rules for Agents
- NEVER delete existing sections or conclusions.
- Keep badge styling consistent: `[![#NNN](https://img.shields.io/...)]` next to each experiment title.
- When merging new content, update the canonical entry instead of duplicating it.
- Leave `## Uncategorized` empty whenever possible; a single placeholder sentence is fine.
- Ask for guidance if an experiment does not map cleanly to known categories.

## Validation
- `rg "^- " docs/reports/index.md` to confirm bullets exist only under curated sections, not under `## Uncategorized`.
- Re-run `uv run scripts/pm/itemize_experiment_issues.py` if unsure that all experiments were captured.
- Optional: `markdownlint docs/reports/index.md` to catch formatting drift.

## See Also
- `scripts/pm/itemize_experiment_issues.py` for source data generation.
- `.agents/skills/archive-experiments/SKILL.md` for retiring legacy experiments.

More agent context in marin-community/marin

43 other files this repository gives its agents.