These instructions apply to all AI-assisted contributions to vllm-project/vllm. Breaching these guidelines can result in automatic banning. Before proposing a PR, run these checks: Do not open one-off PRs for tiny edits (single typo, isolated style change, one mutable default, etc.). Mechanical cleanups are acceptable only when bundled with substantive work. - Pure code-agent PRs are not allowed. A human submitter must understand and defend the change end-to-end. - The submitting human must review every changed line and run relevant…
2 projects use a version of this
97k11d agoReviewMountCreate a free account to mount
Determine the correct behavior of vLLM's OpenAI-compatible or Anthropic-compatible API by checking the official upstream spec, instead of guessing from vLLM's own code. Use for any bug, issue, PR, review, or question touching /v1/chat/completions, /v1/completions, /v1/responses, /v1/embeddings, /v1/messages, or their request/response models — including "is this a bug or intended", "what should this field default to", "does upstream allow this", and any change that adds, removes, or renames a field on those models. Do not use for vLLM-internal APIs (engine, scheduler, LLM class) or for endpoints with no upstream counterpart.
Surging4 mentions in 2 weeks
2 projects use a version of this
97k11d agoReviewMountCreate a free account to mount
Fetch and diagnose vLLM Buildkite CI failure logs. Use when investigating failing CI jobs on a PR or build, when the user pastes a buildkite.com URL, or asks to fetch/diagnose CI logs.
2 projects use a version of this
97k11d agoReviewMountCreate a free account to mount
Debug CUDA illegal memory access (IMA) errors in vLLM with CUDA core dumps and cuda-gdb. Use when a vLLM run crashes or hangs with a CUDA illegal memory access, device-side assert, or other asynchronous CUDA error and the faulting kernel needs to be located.
2 projects use a version of this
97k11d agoReviewMountCreate a free account to mount
Build, debug, and interpret vLLM GPU kernel microbenchmarks for CUDA, ROCm/HIP, Triton, and CuteDSL, including CUPTI timing, correctness checks, generated-code inspection, multi-GPU measurements, and SOL sanity checks. Use when measuring or comparing the performance of a single GPU kernel or op, validating a claimed kernel speedup, or investigating a noisy or surprising benchmark result.
2 projects use a version of this
97k11d agoReviewMountCreate a free account to mount
Time a vLLM model's forward pass on exact batch shapes (decode, prefill, chunked prefill, prefix hit, spec-decode verify, or mixes) with `vllm bench forward`, single-GPU or DP/TP/EP across nodes. Use for per-step model latency, layout/parallelism comparisons, and checking a model-level optimization. Not for single kernels (use kernel-microbenchmark) or end-to-end serving (use `vllm bench serve`).
Surging4 mentions in 2 weeks
2 projects use a version of this
97k11d agoReviewMountCreate a free account to mount
Prepare a vLLM change for human PR review or re-review, or analyze an open pull request. Use before opening a PR, drafts included (e.g. `gh pr create`), or pushing review fixes, to check design fit, behavioral coverage, performance evidence, diff quality, and closure of previous feedback.
Surging4 mentions in 2 weeks
9 projects use a version of this
97k11d agoReviewMountCreate a free account to mount
Playbook for changing vLLM's Transformers version bounds. Use when bumping the pinned or maximum Transformers version, raising the minimum Transformers version, or deleting vendored configs, processors, or compat shims that upstream Transformers now provides.
Surging4 mentions in 2 weeks
2 projects use a version of this
97k11d agoReviewMountCreate a free account to mount
Write or review Triton kernels for vLLM, with practical guidance for generated-code inspection, launch grids, indexing, specialization, tuning, and representative performance validation. Use when adding, modifying, optimizing, or reviewing a `@triton.jit` kernel in vLLM.
2 projects use a version of this
97k11d agoReviewMountCreate a free account to mount
This project implements an alternative, Rust-native frontend to the vLLM Engine. It is still experimental and actively evolving. The Python frontend is the behavioral reference for the OpenAI-compatible API; see Python frontend parity. Requests flow HTTP/gRPC DTO → chat or text request → engine request. Dependencies point downward: lower crates know nothing about the crates above them. Put a rule in the crate that owns its semantics, even if only one protocol triggers it today. The remaining crates are tooling…
2 projects use a version of this
97k11d agoReviewMountCreate a free account to mount
- Test real objects on the lightest real path. Construct vLLM objects with their real constructors; do not stand them in with SimpleNamespace or MagicMock, set private attributes, or patch methods to reach a state. Mock only external services. Pick the cheapest setup that exercises the change: a layer or kernel test does not need vllm_runner, and single-rank parallel state is enough when parallelism is irrelevant. A fix to user-visible behavior needs at least one regression test through LLM (vllm_runner)…
Surging4 mentions in 2 weeks
1 project uses a version of this
97k11d agoReviewMountCreate a free account to mount
Read CONTRIBUTING.md before contributing. Use the relevant repository skill: precheck-pr for author self-checks, or review-pr for independent reviews. Before code changes, issue triage or PR reviews, read relevant review and issue lessons and verify their evidence against the current revision.
7.6k52d agoReviewMountCreate a free account to mount
Develop stylized 3D narrative shorts through story, character and environment references, timed shot tables, storyboards, generation, and assembly. Use for coherent animated storytelling or its planning stages, not isolated image edits or photorealistic live action.
7.6k52d agoReviewMountCreate a free account to mount
Plan, prompt, or produce brand, product, website, app, and service promotional shorts using traceable assets, accurate claims, timed beats, and clear calls to action. Use for launch and campaign videos, not invented product evidence or long narrative films.
7.6k52d agoReviewMountCreate a free account to mount
Design or generate a two-player co-op game menu and opening animation from player names, title, style, and optional identity references. Use for character-led game intros, not playable game implementation or complex multi-page interfaces.
7.6k52d agoReviewMountCreate a free account to mount
Write MiniMax H3 video generation prompts for T2VA, I2VA, FL2VA, L2VA, and Ref2VA. Use when rewriting multimodal requests into H3 prompt structures, composing integrated_multimodal_description, overall_soundscape, and non_diegetic_music, aligning keyframes, or defining reference labels for images, videos, and audio.
7.6k52d agoReviewMountCreate a free account to mount
Write or generate a continuous live-action scene with a rough luminous hand-drawn entity that contacts real objects, morphs, and escapes a slightly delayed handheld camera. Use for gentle surreal mixed-media shorts, not flat-vector-only animation or horror clips.
7.6k52d agoReviewMountCreate a free account to mount
Plan, prompt, or produce minimalist product advertising shorts from product images, preserving variants, material, color, concise typography, and rhythmic camera motion. Use for product launches and ecommerce films, not presenter-led ads or complex UI demonstrations.
7.6k52d agoReviewMountCreate a free account to mount
Plan, write, audit, or produce music videos with coordinated music, imagery, camera motion, optional performance, and lyric typography. Use for beat-aware MVs and instrumental visual narratives, not ordinary subtitle cleanup or unrelated video edits.
7.6k52d agoReviewMountCreate a free account to mount
Plain text files in a repository that tell a coding agent how the project works: commands to run, conventions to follow and things to avoid. CLAUDE.md, AGENTS.md, cursor rules and skills are the common kinds.
CLAUDE.md or AGENTS.md?
CLAUDE.md is read by Claude Code. AGENTS.md is an open format that Codex, Cursor and other agents read. Many projects keep one and point the other at it.
What is a skill?
A folder with a SKILL.md that describes one capability, such as filling PDFs or reviewing code. The agent loads it only when the task calls for it.
Can I search my own team's files too?
Your agents already can, over MCP, limited to the files you're allowed to read. Searching them from this page is coming.