aibrix
AGENTS.md5.2k starsChanged 57 days agoApache-2.0View on GitHub
AIBrix is a Kubernetes-native platform for scalable GenAI inference infrastructure. - Understand the problem and define success before making a non-trivial change. Ground decisions in existing implementations, tests, and verified evidence; do not infer behavior from filenames. - Make the smallest coherent change. Preserve unrelated work and existing conventions; avoid speculative abstractions and unrelated cleanup. - Treat public contracts and compatibility as design constraints. Keep API definitions declarative and policy in the layer that owns it. Preserve API, HTTP, CLI,…
Trending
More talk lately.about the whole repository
Who's talking about vllm-project/aibrix
- vllm-project/vllm“[Roadmap] vLLM Roadmap Q2 2025”GitHub · Mar 29, 2025 · 57 reactions
- @sungkim.bsky.social“Repo: github.com/vllm-project...”Bluesky · Feb 23, 2025 · 4 likes
- istio/istio“gateway infrastructure support”GitHub · Mar 13, 2025 · 3 reactions
- envoyproxy/gateway“support endpoint picker based on header/dynamic metadata”GitHub · May 30, 2025 · 2 reactions
- @pythonhub.dev“AIBrix Cost-efficient and pluggable Infrastructure components for GenAI inference. …”Bluesky · Mar 7, 2025 · 2 likes
The biggest 5 of 39 mentions linking to the repository that our crawl found. Each line is their own headline.
See all 39
Talked about on GitHub, Bluesky and Hacker News (39 times).
On GitHub · 34
- Mar 29, 2025[Roadmap] vLLM Roadmap Q2 2025 — vllm-project/vllm57 reactions · 21 comments
- Mar 13, 2025gateway infrastructure support — istio/istio3 reactions · 2 comments
- May 30, 2025support endpoint picker based on header/dynamic metadata — envoyproxy/gateway2 reactions · 21 comments
- Oct 9, 2026[CI] Cut avoidable waits from the installation E2E suite — Jeffwan/aibrix1 reaction · 2 comments
- Dec 1, 2025Blog about current open-source inference orchestration solutions — pacoxu/AI-Infra1 reaction
29 more on GitHub
- Sep 22, 2025Workloads solutions — pacoxu/AI-Infra1 reaction · 1 comment
- Aug 18, 2025Add AIBrix Intro — pacoxu/AI-Infra1 reaction
- Oct 27, 2026[Docs] Clarify hybrid-state contracts and the runnable CPU entry — mynotwo/aibrix-hybrid-kvcache0 reactions
- Oct 21, 2026[UI] Add ModelClaim pages to the console — sjmaple/cr-aibrix0 reactions
- Oct 21, 2026[Feat] Add a ModelClaim BFF to the console API — sjmaple/cr-aibrix0 reactions
- Oct 20, 2026[Bug] Keep a saved startup KV ceiling across a transient identity-read failure — sjmaple/cr-aibrix0 reactions
- Sep 16, 2026LLMルーティング・ゲートウェイ — warabinbin/papers0 reactions · 1 comment
- Sep 16, 2026推論最適化ツール・OSS — warabinbin/papers0 reactions
- Sep 3, 2026[API] Reject StormService /scale above 1 in Pooled mode — roshpr/aibrix0 reactions
- Jun 23, 2026docker.io/aibrix — DaoCloud/public-image-mirror0 reactions · 2 comments
- Jun 22, 2026[upstream-sync] Upstream aibrix v0.7.0 GA released (2026-06-18) — plan fork adoption — BudEcosystem/aibrix0 reactions
- Jun 15, 2026[upstream-sync] Sync fork to upstream v0.7.0-rc and plan v0.7.0 adoption — BudEcosystem/aibrix0 reactions · 1 comment
- Jun 2, 2026[Add] AIBrix (vllm-project/aibrix) — PyTorchKR/landscape0 reactions
- May 24, 2026ParseMetricsURL did not check HTTP status codes. — volcano-sh/kthena0 reactions · 2 comments
- May 13, 2026How to choose the inference orchestration solution? AIBrix or Kthena or Dynamo? — pacoxu/pacoxu0 reactions
- Apr 13, 2026[RFC]: Add optional `before_update_states` hook to `KVConnectorBase_V1` for external KV cache integrations — vllm-project/vllm0 reactions · 8 comments
- Feb 13, 2026[Core] Add ray wait CLI and ray.wait_for_nodes() to wait for workers and prevent job failure — ray-project/ray0 reactions · 4 comments
- Feb 13, 2026[Request] how to upgrade controller-runtime from v0.12.1 to v.19.2 — kubernetes-sigs/controller-runtime0 reactions · 4 comments
- Jan 5, 2026[Report issue] vLLM — linuxfoundation/insights0 reactions · 2 comments
- Dec 1, 2025Blog: Inference orchestration solutions and convergence trends — pacoxu/AI-Infra0 reactions
- Oct 15, 2025Add `docker model k8s` command for Kubernetes deployment — ericcurtin/model-runner0 reactions
- Sep 11, 2025Implement comprehensive RAG platform with official AIBrix SDK integration — luxtelos/ai-k30 reactions · 8 comments
- Aug 18, 2025Add comprehensive AIBrix introduction with Chinese presentation video to AI-Infra documentation — pacoxu/AI-Infra0 reactions · 2 comments
- Jul 30, 2025[Bug] Failed to select PD pair: Failed to select worker pair P/D — sgl-project/sglang0 reactions · 9 comments
- Jul 3, 2025revert change to the calculation of gpu cache usage score filter — volcano-sh/kthena0 reactions · 1 comment
- Jun 25, 2025Add Prefill/Decode Disaggregation Support — theagentrouter/agent-router0 reactions · 3 comments
- May 15, 2025chdir to cwd (\"/home/nonroot\") set in config.json failed: permission denied": unknown — envoyproxy/gateway0 reactions · 2 comments
- Apr 18, 2025feature: Integrate upstream crd verification — InftyAI/llmaz0 reactions · 3 comments
- Mar 31, 2025[core][API] Provide an API to wait for the cluster to reach specific conditions — ray-project/ray0 reactions · 4 comments
On Bluesky · 3
- Feb 23, 2025Repo: github.com/vllm-project... — @sungkim.bsky.social4 likes and reposts
- Mar 7, 2025AIBrix Cost-efficient and pluggable Infrastructure components for GenAI inference. https://github.com/vllm-project/aibrix — @pythonhub.dev2 likes and reposts
- Feb 24, 2025A cloud-native solution optimized for deploying, managing, and scaling large language model (LLM) inference, explicitly tailored to… — @golangch.bsky.social1 likes and repost
On Hacker News · 2
- Feb 23, 2025Cost-efficient and pluggable Infrastructure components for GenAI inference1 point
- Feb 22, 2025Cost-efficient and pluggable Infrastructure components for GenAI inference1 point
Where files are headingNew AGENTS.md files have more rules about keeping secrets out of the code, and fewer about code style.
Of the AGENTS.md files we read, the 31,774 first seen in the last six months, against the older ones: the kind of rule that gained most share, and the kind that lost most. About files like this in general, not this one, and an estimate, since a kind is a pattern in the words.
The file
We split this AGENTS.md into the rules it gives an agent
6 rules. About 0 are common, 5 are distinctive, and 1 is very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈5
Distinctive · estimate
This author's own choices. Worth a look.
1
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 12
Treat public contracts and compatibility as design constraints.
- Distinctive: line 15
Verify observable behavior at the narrowest useful level, then expand checks to match the change's scope.
- Distinctive: line 18
Keep documentation and generated artifacts consistent with the implementation.
- Very specific: line 26
Before implementing a feature or bug fix for a non-maintainer, check existing issues and PRs and wait for a maintainer to apply …
- Distinctive: line 42
Read the relevant guide before changing that area.
- Distinctive: line 45
Before implementation or PRs: Contribution policy.
≈ “Common” is an estimate: at least 1 in 5 of the 40,246 AGENTS.md files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
AIBrix
AIBrix is a Kubernetes-native platform for scalable GenAI inference infrastructure.
Principles
- Understand the problem and define success before making a non-trivial change. Ground decisions in existing implementations, tests, and verified evidence; do not infer behavior from filenames.
- Make the smallest coherent change. Preserve unrelated work and existing conventions; avoid speculative abstractions and unrelated cleanup.
- Treat public contracts and compatibility as design constraints. Keep API definitions declarative and policy in the layer that owns it. Preserve API, HTTP, CLI, configuration, and metadata contracts; plan compatibility migrations.
- Verify observable behavior at the narrowest useful level, then expand checks to match the change's scope. Report what ran, what passed, and what remains unverified.
- Keep documentation and generated artifacts consistent with the implementation. Review every generated or AI-assisted change; submit only what you can explain.
- Respect authorization boundaries. Do not push, rewrite history, change remote
GitHub state, or send external messages without explicit authorization. Ask
before upgrading dependencies or changing workflow policy under
.github/.
Contribution gates
- Before implementing a feature or bug fix for a non-maintainer, check existing
issues and PRs and wait for a maintainer to apply
triage/acceptedto the issue. Until then, limit work to investigation, reproduction, and improving the issue; do not implement the change or prepare a PR. - Maintainers listed on the community page may self-triage routine fixes. Sensitive or broad changes still require prior discussion and independent maintainer review.
- Pure documentation corrections and obvious mechanical fixes may proceed without an accepted issue only if they do not change behavior, configuration, dependencies, workflows, APIs, or generated files. Test-only changes are not automatically exempt; identify the real behavior or risk they protect.
- Acceptance covers the problem and direction, not approval of a patch. Return to the issue for agreement before materially expanding the accepted scope.
Task guides
Read the relevant guide before changing that area; use the sections needed for
this task. Rules in a deeper AGENTS.md take precedence for that directory.
- Before implementation or PRs: Contribution policy.
- Go, APIs, controllers, and code generation: Development guide.
- Tests: Test guide.
- Documentation and translations: Documentation guide.
- Python runtime: python/aibrix/AGENTS.md.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

