torch_bisect

---
name: torch_bisect
description: Bisect PyTorch commits to find the regression that breaks TorchTitan. Use when the user wants to bisect PyTorch or invokes /torch_bisect.
disable-model-invocation: true
---

# PyTorch Git Bisect for TorchTitan

Bisect the PyTorch repo to find the commit that broke TorchTitan.
Always use absolute paths — shell state does not persist between Bash calls.

## Phase 1: Gather Information

Record the TorchTitan directory (`pwd`). Then check if
`~/.claude/torchtitan_torch_bisect_cache.json` exists — if so, show cached
values and let the user reuse or override them.

Collect via AskUserQuestion (pre-fill from cache if available):

1. **PyTorch repo path** — absolute path to local checkout
2. **Build command** — shell command to recompile PyTorch after each checkout
3. **Test command** — run from TorchTitan dir; must exit 0 on good commits,
   non-zero on bad. Judge ONLY by exit code, never by log content.
4. **Good commit** — a commit hash or a date (e.g., `Feb 15`)
5. **Timeout policy** — if test exceeds 10 min, auto-mark bad or ask each time?

After collecting, offer to save answers to the cache file.

## Phase 2: Setup

1. **Check GitHub connectivity**: run `curl -s -o /dev/null --connect-timeout 20 -w "%{http_code}" https://github.com`.
   If it fails or returns non-200, tell the user GitHub is not reachable and
   suggest checking internet connectivity or proxy settings. On Meta internal
   servers, suggest setting `https_proxy=http://fwdproxy:8080`. Do not proceed
   until connectivity is confirmed.
2. `cd <pytorch> && git fetch origin` (timeout 300000ms). On failure, ask user
   to fix (remind about proxy/fwdproxy if it looks like a network error).
3. Check `git bisect log 2>&1` — if a bisect is active, ask user to reset or abort.
4. Resolve the good commit:
   - Hash: verify with `git log -1 <hash>`
   - Date: `git log origin/main --before="<DATE>T23:59:59" --format="%H %s" -1`
     — show result and confirm with user.
5. Bad commit is `origin/main`. Show it to user.
6. Show `git rev-list --count <good>..origin/main` and estimated steps (~log2).
7. Run each bisect command individually so failures can be reported cleanly:
   - `git bisect start`
   - `git bisect bad origin/main`
   - `git bisect good <good>`
   If any step fails, show the error and run `git bisect reset` before asking
   the user how to proceed.

## Phase 3: Bisect Loop

Repeat until bisect finds the first bad commit:

**A. Build** — run build command in PyTorch dir (timeout 600000ms).
On failure: show last 50 lines, ask user to **Skip** / **Retry** / **Abort**.

**B. Test** — run test command in TorchTitan dir (timeout 600000ms).
Exit 0 = good, non-zero = bad. On timeout, follow user's policy from Phase 1.
Never analyze logs — use only exit code.

**C. Record** — `git bisect good` or `git bisect bad` in PyTorch dir.
- Output contains "is the first bad commit" → done, go to Phase 4.
- Output contains "Bisecting:" → continue loop.
- Cannot narrow further (too many skips) → tell user, suggest abort.

**D. Progress** — print step number, commit hash, good/bad, remaining count.

## Phase 4: Report and Cleanup

1. Capture `git bisect log` and `git show --stat <bad_commit>`.
2. Extract PR number from commit subject (`(#NNNNN)` pattern). If found, run
   `gh pr view <N> --repo pytorch/pytorch --json title,body,url` to get PR
   details. Fallback URL: `https://github.com/pytorch/pytorch/pull/<N>`.
3. `git bisect reset`.
4. Present summary:

```
## Bisect Complete
**First bad commit:** <hash>
**Commit message:** <subject>
**Author:** <author> | **Date:** <date>

### Associated Pull Request
**PR:** #<N> — <title>
**Link:** https://github.com/pytorch/pytorch/pull/<N>
**Summary:** <first ~20 lines of PR body>

### Changed files
<git show --stat output>

### Full bisect log
<git bisect log output>
```

Omit the PR section if no PR number was found. Do NOT diagnose root cause.

## Rules

- Always use absolute paths.
- Judge test results by exit code only — never analyze output.
- On unexpected errors, show the error and ask the user before proceeding.
- Keep the user informed after every bisect step.

More agent context in pytorch/torchtitan

6 other files this repository gives its agents.