oob-perf-analysis
Skill121 starsChanged 5 months agoApache-2.0View on GitHub
Generate and analyze T1/T2/R roofline reports for PyTorch OOB workloads comparing Intel XPU and NVIDIA CUDA. Use when working with eager profiling artifacts, per-model reports, fleet summaries, graph consistency, or XPU-vs-CUDA software efficiency analysis.
In this repository28 other files it gives its agents.
- CLAUDE.mdCLAUDE.md
- .github/copilot-instructions.mdCopilot instructions
- asm-source-mappingSkill
- at-dispatch-v2Skill
- auto-labelSkill
- extract-asm-onednnSkill
- extract-asm-syclkernel-aotSkill
- extract-asm-syclkernel-jitSkill
- extract-asm-tritonSkill
- extract-xpu-kernel-asmSkill
- fix-implementSkill
- fix-reproduceSkill
- fix-root-causeSkill
- fix-verifySkill
- issue-handlerSkill
- issue-triageSkill
- label-issueSkill
- pr-reviewSkill
- release-branchingSkill
- skill-writerSkill
- ut-checkSkill
- ut-issue-authoringSkill
- ut-refactor-reviewSkill
- xpu-alignmentSkill
- xpu-build-pytorchSkill
- xpu-ci-health-checkSkill
- xpu-ops-pr-creationSkill
- xpu-release-notesSkill
The file
We split this skill into the rules it gives an agent
5 rules. About 0 are common, 1 is distinctive, and 4 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈1
Distinctive · estimate
This author's own choices. Worth a look.
4
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Very specific: line 34
Follow: methodology.md → inputs.md → per-model-report.md
- Very specific: line 40
Follow: fleet-summary.md (references graph-consistency.md for Section 7)
- Very specific: line 62
Read methodology.md before computing any metric.
- Very specific: line 63
Read inputs.md before accessing any artifact.
- Distinctive: line 66
If a calling workflow explicitly requires a skill marker, append this exact literal final line: Custom skills applied: oob-perf-analysis.
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
OOB Perf Analysis Skill
Analyzes OOB eager-mode performance using T1/T2/R roofline methodology to compare XPU and CUDA software efficiency.
Core outputs (all under agent_space_xpu/, git-ignored):
- Per-model markdown reports under
agent_space_xpu/reports/<session>/models/ - Fleet summary under
agent_space_xpu/reports/<session>/summary_eager_inference.md - Graph consistency report under
agent_space_xpu/reports/<session>/graph_consistency_eager_inference.md - Insights summary under
agent_space_xpu/reports/<session>/insights_summary.md
References
| File | Purpose |
| methodology.md | T1/T2/R definitions, formulas, classification thresholds |
| inputs.md | Input file formats, completeness rules, output paths |
| per-model-report.md | Per-model analysis steps and 5-section report structure |
| fleet-summary.md | Fleet aggregation steps and 7-section report structure |
| graph-consistency.md | Graph consistency analysis |
| insights.md | Developer-facing insights summary |
| troubleshooting.md | Diagnosing abnormal R, trace issues, and data problems |
Usage Modes
Per-Model Report Mode
User has raw artifacts and wants model-level T1/T2/R analysis.
Follow: methodology.md → inputs.md → per-model-report.md
Fleet Summary Mode
User wants fleet-wide comparison, model scorecards, op ranking, or projection-quality aggregation.
Follow: fleet-summary.md (references graph-consistency.md for Section 7)
Graph Consistency Mode
User wants to compare CUDA vs XPU computational graphs.
Follow: graph-consistency.md
Insights Mode
Per-model reports and fleet summary exist; user wants a concise developer-facing summary.
Follow: insights.md
Troubleshooting Mode
User asks why R is abnormal, why traces disagree, or why results look suspicious.
Follow: troubleshooting.md
Operating Rules
- Read
methodology.mdbefore computing any metric. - Read
inputs.mdbefore accessing any artifact. - Report structure is deterministic — same inputs produce same section layout.
If a calling workflow explicitly requires a skill marker, append this exact literal final line: Custom skills applied: oob-perf-analysis.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

