pr-description
Skill5.9k starsChanged 3 days agoBSD-3-ClauseView on GitHub
Write a torchtitan PR description that convinces a human reviewer -- concrete problem with a simple example, what changed, user-facing before/after, numerics, testing. Use when opening or updating a PR, or when asked to write or improve a PR summary.
We split this skill into the rules it gives an agent
3 rules. 0 are common, 3 are distinctive, and 0 are very specific to this project.
0
Common
Most of the 82 edited versions we read keep these.
3
Distinctive
This author's own choices. Worth a look.
0
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 15
Never write the "Summary (human-written)" section.
- Distinctive: line 33
Keep it scannable: short sections, tables over prose.
- Distinctive: line 36
Don't include sections with nothing to say.
“Common” is measured: kept by at least 6 in 10 of the 82 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Writing a torchtitan PR Description
A maintainer reads the description first and must be convinced by it. They don't want a narration of the diff; they want to know what problem exists, why this is the right fix, and what evidence shows it works. Write for a reviewer who knows torchtitan but not your context.
Rules
- Never write the "Summary (human-written)" section. Leave its placeholder for the author, and tell the user to fill it in before review. Don't draft text for them to paste. With ghstack the PR body is the commit message, so keep the placeholder there too.
- Lead with the problem, in concrete terms. If you can't state a concrete input
that misbehaves on
main(or a concrete thing that is hard to do today), stop and reconsider whether the PR should exist. - Include a simple example: a few lines showing the scenario before and after (a config snippet, a tiny tensor/sequence example, an ASCII diagram of data or control flow). This is the part reviewers ask for most often.
- Say why this is the right layer and the smallest fix, and name the alternatives you rejected in one line each. If the fix works around an upstream gap, link the upstream issue.
- Separate mechanical changes (moves, renames) from logic changes, and say which files reviewers can skim. For large changes, split commits into moves-only and logic commits, or stack PRs ("Stacked on #N").
- State evidence, not claims: numerics table, perf numbers end to end, the exact
command. List failures that also happen on
mainseparately. - Keep it scannable: short sections, tables over prose. Don't paste a long agent transcript; if an agent wrote the summary, a human must have checked it says what concretely changes.
- Don't include sections with nothing to say.
Template
## Summary (human-written)
<!-- Write this yourself, not with an AI tool. 2-5 sentences: the problem, why
this approach, and what you checked yourself. -->
## Why
<The concrete problem: what fails or is hard today, for whom. 2-5 sentences.>
**Example.**
<5-15 lines: minimal scenario, before vs. after.>
## What changed
- <grouped by concern; mark mechanical parts as such>
## Alternatives considered
- <one line each, why not>
## User-facing changes
| Before | After |
| --- | --- |
| `old.config.path` | `new.config.path` |
## Numerics
<For non-computation changes: bitwise-identical loss and grad_norm vs. base
commit <sha> (seed 42, deterministic, `scripts/loss_compare.py --assert-equal`),
per parallelism layout touched. For computation changes: convergence evidence
and an explanation of expected golden-loss changes.>
| Config | GPUs | Result |
| --- | --- | --- |
## Performance
<Only if relevant: TPS/MFU and memory before vs. after, end to end, same config.>
## Testing
<What you ran, on what hardware, and which existing tests cover the change. For
each new test, the regression it catches.>
## Known issues / follow-ups
<Failures that reproduce on main; TODOs left in code; next PR in the stack.>Trending
More talk lately.about the whole repository
Who's talking about pytorch/torchtitan
- pytorch/pytorch“Add outer-product-decomo”GitHub · Mar 5, 2026 · 6 reactions
- verl-project/verl“[roadmap] TorchTitan Integration into Verl”GitHub · Feb 12, 2026 · 6 reactions
- pytorch/ao“[RFC] NVFP4 Rounding Modes”GitHub · Oct 30, 2025 · 6 reactions
- pytorch/pytorch“[RFC][DTensor] make registered ops higher precedence than decomps”GitHub · Jul 25, 2025 · 4 reactions
- meta-pytorch/torchtune“[RFC] Long context fine tuning in torchtune”GitHub · Jul 30, 2024 · 4 reactions
The biggest 5 of 53 mentions linking to the repository that our crawl found. Each line is their own headline.
See all 53
Talked about on GitHub, Bluesky and Hacker News (53 times).
On GitHub · 50
- Mar 5, 2026Add outer-product-decomo — pytorch/pytorch6 reactions · 14 comments
- Feb 12, 2026[roadmap] TorchTitan Integration into Verl — verl-project/verl6 reactions · 5 comments
- Oct 30, 2025[RFC] NVFP4 Rounding Modes — pytorch/ao6 reactions · 6 comments
- Jul 25, 2025[RFC][DTensor] make registered ops higher precedence than decomps — pytorch/pytorch4 reactions · 3 comments
- Jul 30, 2024[RFC] Long context fine tuning in torchtune — meta-pytorch/torchtune4 reactions · 22 comments
45 more on GitHub
- Sep 23, 2026[fsdp2] Optionally keep unsharded storage across reshard — pytorch/pytorch3 reactions · 6 comments
- Dec 24, 2025Switch from flat colexigraph to structred indexing — pytorch/pytorch3 reactions · 3 comments
- Oct 17, 2025[FlexAttention][CUDA] Add flex configs for Blackwell — pytorch/pytorch3 reactions · 4 comments
- Sep 26, 2025[FSDP2] support AC(FSDP) for torchtitan's MOE — pytorch/pytorch3 reactions · 10 comments
- Sep 6, 2025Add transformers backend (Dense model only) — huggingface/torchtitan3 reactions · 3 comments
- Jul 4, 2025Add DeepSeekV3 and figure out what's needed to support it — meta-pytorch/autoparallel3 reactions · 10 comments
- May 29, 2025Selective activation checkpointing causes memory leakage — pytorch/pytorch3 reactions · 5 comments
- Apr 17, 2025FSDP2 tutorial outline — pytorch/pytorch3 reactions · 6 comments
- Feb 25, 2025Flex Attention is incompatible with selective AC — pytorch/pytorch3 reactions · 16 comments
- Jul 29, 2024Quantized Training — pytorch/ao3 reactions · 6 comments
- Jul 15, 2024Adam-mini <> DTensor — zyushun/Adam-mini3 reactions · 10 comments
- Jan 27, 2026[trainer] feat: Add Torchtitan as alternative training engine — verl-project/verl2 reactions · 6 comments
- Sep 17, 2025[FSDP2] idempotent reset_sharded_param: no-op if _local_tensor is already padded — pytorch/pytorch2 reactions · 15 comments
- Jul 26, 2025[DeepSeek-V3] Different rotary embedding implementation between DeepSeek-AI and Transformers — huggingface/transformers2 reactions · 25 comments
- Jul 24, 2025[RFC] Support slicing of submesh and more flexible operations to one device mesh such as reshape/split, etc. — pytorch/pytorch2 reactions · 22 comments
- Jul 20, 2025[DTensor] Add fused rms norm dtensor op strategy — pytorch/pytorch2 reactions · 5 comments
- Jul 10, 2025Fix DTensor handling of conjugate bit. — pytorch/pytorch2 reactions · 3 comments
- Jul 2, 2025DDP+TP composition does not work as expected — pytorch/pytorch2 reactions · 2 comments
- Jun 29, 2025[DTensor][FSDP2] necessary changes to FSDP and TP to unblock EP — pytorch/pytorch2 reactions · 18 comments
- May 8, 2025Fix ManagedProcessGroup when used with c10d APIs — meta-pytorch/torchft2 reactions · 1 comment
- Apr 5, 2025[DTensor] Add DTensor redistribute fwd/bwd datatype conversion to enable SimpleFSDP mixed precision training — pytorch/pytorch2 reactions · 7 comments
- Mar 4, 2025Bring in DSV3 from torchtitan — meta-pytorch/torchtune2 reactions · 3 comments
- Dec 23, 2024CUDA error when compiling loss function — pytorch/pytorch2 reactions · 1 comment
- Jun 25, 2024[minor] Improved `repeat_kv` eager perf — meta-llama/llama32 reactions
- Oct 26, 2026Random weight init bug when using FSDP2 + CPU Offload — pytorch/pytorch1 reaction · 2 comments
- Sep 10, 2026[BUG] DTensor RNG tracker is applied to CPU tensors under FSDP2 CPUOffloadPolicy, resetting the CPU RNG state — pytorch/pytorch1 reaction
- Jul 6, 2026[trainer] fix: spmd_types and activation checkpointing composability bug — verl-project/verl1 reaction · 1 comment
- May 26, 2026[FSDP][AC] Bypass SAC tracking for all-gather internals — pytorch/pytorch1 reaction · 2 comments
- May 14, 2026Add Triton SymmetricMemory MoE all-to-all dispatch/combine — meta-pytorch/kraken1 reaction
- May 1, 2026[pipelining] Fix None gradient handling in backward send/recv — pytorch/pytorch1 reaction · 4 comments
- Apr 23, 2026[Bugfix] Fix codegen for unqualified names — vllm-project/vllm1 reaction · 2 comments
- Mar 3, 2026[fully_shard][DTensor] Support fully_shard with DTensor on full SPMD mesh — pytorch/pytorch1 reaction · 3 comments
- Jan 8, 2026MXFP8 MoE training prototype graduation tracker — pytorch/ao1 reaction
- Dec 29, 2025Update torchao requirement from <0.15,>=0.12 to >=0.12,<0.16 — oumi-ai/oumi1 reaction · 1 comment
- Dec 11, 2025refactor + robusts tests for Tensor Parallel — huggingface/transformers1 reaction · 11 comments
- Nov 20, 2025[simplefsdp] fix simplefsdp llama3 run — pytorch/pytorch1 reaction · 6 comments
- Nov 5, 2025Inductor Lite Mode — pytorch/pytorch1 reaction · 8 comments
- Oct 14, 2025Fix gradient explosion in bfloat16+float8 rowwise quantization — pytorch/ao1 reaction · 2 comments
- Sep 22, 2025Garbage collect on every train / ref model step — meta-pytorch/torchforge1 reaction
- Sep 16, 2025[cuDNN][SDPA][submodule] Roll-back cuDNN frontend upgrade, update Meta registration — pytorch/pytorch1 reaction · 8 comments
- May 14, 2025Feature request: support different input/output formats in the same recipe — meta-pytorch/torchtune1 reaction · 1 comment
- Feb 10, 2025Disable `reshard_after_forward` for last transformer layer FSDP param group — meta-pytorch/torchtune1 reaction · 2 comments
- Sep 22, 2024[RFC] Composable parallel documentation — pytorch/pytorch1 reaction
- May 2, 2024FSDP+PP bug where reshard_after_forward must be true — pytorch/PiPPy1 reaction · 6 comments
- May 2, 2024FSDP+PP tracer issue with cast-to-bf16 — pytorch/PiPPy1 reaction · 9 comments
On Bluesky · 2
- Oct 16, 2024Repo: github.com/pytorch/torc... Video: www.youtube.com/watch?v=ee5D... — @sungkim.bsky.social1 likes and repost
- Sep 19, 2024🔥 Hot Repo! 🔥 (100+ new stars) 📦 pytorch / torchtitan ⭐ 1,790 (+190) 🗒 Python A native PyTorch Library for large model training — @github-trending.bsky.social0 likes and reposts · 1 reply
On Hacker News · 1
- Jul 16, 2024Torchtitan: Large-scale LLM training using native PyTorch1 point
Other versions87 projects use a version of this.
Word for word · 0
None found.
Edited · 0
None found.
Wrote their own version · 87
- jdx/mise★ 35ksame name
- zulip/zulip★ 26ksame name
- Nagi-ovo/gemini-voyager★ 20ksame name
- pipecat-ai/pipecat★ 17ksame name
- ComposioHQ/agent-orchestrator★ 14ksame name
- OrchestratorInc/agent-orchestrator★ 14ksame name
- Untrivial-ai/agent-orchestrator★ 14ksame name
- AgentWrapper/agent-orchestrator★ 13ksame name
- sanity-io/sanity★ 6.4ksame name
- basicmachines-co/basic-memory★ 4.3ksame name
77 more not listed
How matches are found. Word for word: the exact same text. Edited: shares passages with this file (“99% same” means 99% of its five-word phrases also appear here; 10% or more counts). Their own version: similar meaning, or, weakest, the same name. We can’t tell which project had it first. Projects are counted among the 200 most-starred candidates, and mentions are links to the repository we found, up to 50 per site, so both counts are a floor.
Used alongsideProjects with it also use ao-desktop-dev, bug-triage and 10 more.
Other files people use alongside this one.
Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
agentlab-inSkillao-desktop-dev
Launch, restart, or troubleshoot the real AO Electron desktop app from this repository; run a checkout against isolated or real local AO data; combine PR branches for local UI review; and diagnose stale Electron processes, port conflicts, or preload bridge mismatches. Use whenever asked to run, open, show, or visually verify AO frontend changes in the actual desktop app rather than ao preview, dev:web, or mock data.
Also in 4 projects that use this
jMertaSkillbug-triage
Use when the user reports a bug, regression, runtime error, failing build, or broken test and wants reproduction, diagnosis, root-cause analysis, or an authorized fix. Isolates the shared cause and verifies the smallest relevant change.
Also in 4 projects that use this
GitHubSkillcommit-message
Generate conventional commit messages - use when creating commits, writing commit messages, or asking for git commit help
Also in 8 projects that use this
francogalfreSkilldependency-audit
Audits package.json dependencies for outdated packages, security vulnerabilities, unnecessary deps, and version issues. Use when the user says "audit my dependencies", "check my packages", "what deps should I update", "clean up package.json", "are there security issues in my deps", or pastes a package.json.
Also in 3 projects that use this
PydanticSkilli-have-adhd
Shape every response for an ADHD reader who reviews the work but does not do the coding — the agent does. Use whenever responding to ANY message — coding, debugging, planning, casual. Lead with the result or the decision. Surface anything needing the user's input as a structured question, never buried in prose they'll skim past. No preamble, no recap, no closers. State errors matter-of-factly. Make finished work visible. Trigger even on casual messages and even when brevity wasn't requested.
Also in 3 projects that use this
HashiCorpSkillchangelog
Add a `.changelog/<PR_NUMBER>.txt` entry for a GitHub Pull Request, commit, and push.
Also in 5 projects that use this
In this repository8 other files it gives its agents.
- .claude/CLAUDE.mdCLAUDE.md
- cuda_graph_trace_compactionSkill
- fake_distributed_backendSkill
- kernel-numerics-verifierSkill
- local-compile-perfSkill
- numerics_debuggingSkill
- pr-reviewSkill
- torch_bisectSkill
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
Reviews can't be read right now.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

