aistore
AGENTS.md1.9k starsChanged 16 days agoMITView on GitHub
Apply to these directories and all their subdirectories: Before changing, building, or testing CLI/iShard, read CLI or iShard instructions. Elsewhere, check for local instructions. Flag conflicts and cite the relevant document before work. Consult these references as needed for the task: Run from the repository root in Bash, using the Go version in go.mod and Makefile targets. Choose commands for the task. Remaining prompts default to no cloud backends, loopback devices, or tracing. Use make kill before redeploying, or make…
We split this AGENTS.md into the rules it gives an agent
9 rules. About 0 are common, 6 are distinctive, and 3 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈6
Distinctive · estimate
This author's own choices. Worth a look.
3
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 32
Before changing, building, or testing CLI/iShard, read CLI or iShard instructions.
- Very specific: line 46
Run from the repository root in Bash, using the Go version in go.mod and Makefile targets.
- Very specific: line 56
Use make kill before redeploying, or make restart with existing configs.
- Distinctive: line 60
Use existing test infrastructure for behavior and regressions.
- Very specific: line 79
Run formatting and spelling checks.
- Distinctive: line 88
Before using Delve, read debugging.md.
- Distinctive: line 95
Read implementations and callers for each codepath's contracts and lifetimes.
- Distinctive: line 97
Do not redesign shared contracts around a single use.
- Distinctive: line 103
Before committing, follow Commit Messages and contributor requirements for human authorship, sign-off, and disclosure.
≈ “Common” is an estimate: at least 1 in 5 of the 36,368 AGENTS.md files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Core AIStore Agent Instructions
Scope and References
Apply to these directories and all their subdirectories:
ais/ proxy/target nodes, integration tests
api/ Go client API/SDK
cmd/ node, CLI, utility executables
cmn/ shared configuration, types, utilities
core/ object/cluster metadata, internal APIs
ec/ erasure coding
ext/ ETL, dSort, downloader
fs/ mountpaths, object file layout
hk/ periodic housekeeping callbacks
ios/ disk I/O stats, OS storage interfaces
memsys/ slab/SGL memory management
mirror/ local object replicas
nl/ progress/completion notifications
reb/ cluster-wide rebalance
res/ resilvering across local mountpaths
space/ LRU eviction, storage cleanup
stats/ metrics tracking and export
sys/ CPU, memory, load, processes
tracing/ OpenTelemetry distributed tracing
transport/ intra-cluster object streaming
volume/ volume configuration and metadata
xact/ background jobs, registry, implementationsBefore changing, building, or testing CLI/iShard, read CLI or iShard instructions. Elsewhere, check for local instructions. Flag conflicts and cite the relevant document before work.
Consult these references as needed for the task:
- CONTRIBUTING.md: Human responsibility, disclosure, licensing, and DCO.
- overview.md: Architecture, design, and traffic patterns.
- terminology.md: Core abstractions and vocabulary.
- getting_started.md: Local cluster setup.
- development.md: Debugging, scripts, and performance comparisons.
Build and Verification
Run from the repository root in Bash, using the Go version in go.mod and
Makefile targets. Choose commands for the task.
# Local playground: 3 targets, 3 proxies, 4 mountpaths per target.
MODE=debug make cli deploy <<< $'3\n3\n4'Remaining prompts default to no cloud backends, loopback devices, or tracing.
Use make kill before redeploying, or make restart with existing configs.
Repeat required MODE, TAGS, and GORACE settings on rebuilds/restarts.
Validate affected behavior against a running local AIStore cluster. Run focused tests for the changed subsystem; CI provides broader regression coverage. Use existing test infrastructure for behavior and regressions; remove temporary validation tests that have no upstream.
Replace TestName with a relevant test and confirm it runs; no matches is not
verification. Set AIS_ENDPOINT and BUCKET for the test cluster. Match
deployment TAGS and test TEST_TAGS to changed code; omit unused tags.
AIS_ENDPOINT=http://localhost:8080 BUCKET=ais://tmp \
TESTS_DIR=ais/test RE='^TestName$' make test-runFor concurrency changes, enable race detection in both daemons (GORACE) and
affected tests (TEST_RACE=true for make test-run).
For performance-sensitive changes, measure the affected path against a baseline
under comparable conditions. Use relevant microbenchmarks for isolated code and
aisloader for cluster workloads. Confirm measurements are produced.
Run formatting and spelling checks; for core Go changes, also gofmt changed
files and lint. Install a missing linter with make lint-update-ci (CI version).
Activate a Python virtual environment before make fmt-check, which installs Ruff.
make fmt-check spell-check
make lint-scopedBefore using Delve, read debugging.md. Track checks, results, bug reproduction, and incomplete verification for human review; the human contributor owns claims and disclosure.
Engineering Contracts
- Preserve user data. Test changes to integrity, persistence, and transport.
- Read implementations and callers for each codepath's contracts and lifetimes. Preserve them; update all affected callers when changing a contract. Do not redesign shared contracts around a single use.
- Preserve API compatibility. Change APIs only when explicitly instructed; follow maintainer decisions on deprecation.
- Prioritize correctness over performance. Understand synchronization primitives and their responsibilities before changing concurrent code or critical sections.
- Follow Coding Style.
- Before committing, follow Commit Messages and contributor requirements for human authorship, sign-off, and disclosure.
External Sources
AIStore is MIT-licensed. Agents must not copy or adapt third-party code, regardless of license, without copyright-holder permission and explicit maintainer approval. Consult external documentation for interfaces and behavior; implement using AIStore's existing patterns and contracts.
Trending
Steady: 0 new projects took it in the last 4 weeks, none the 4 weeks before.thin data
Who's talking about NVIDIA/aistore
- pytorch/pytorch“[RFC] Add tar-based IterableDataset implementation to PyTorch”GitHub · May 13, 2020 · 87 reactions
- FluxML/Flux.jl“WebDataset.jl, a linearly scalable data loader based on iterable datasets”GitHub · Apr 28, 2021 · 8 reactions
- medyagh/setup-minikube“Add Timeout Option for Minikube Setup”GitHub · Feb 22, 2025 · 4 reactions
- @taras.glek.net“Never really enjoyed working with minio. Looks like nvidia has a higher performing alternative (also in …”Bluesky · Dec 14, 2025 · 2 likes
- tensorflow/tensorflow“S3 ParseURI supporting query parameters”GitHub · Jul 28, 2020 · 2 reactions
The biggest 5 of 28 mentions linking to the repository that our crawl found. Each line is their own headline.
See all 28
Talked about on GitHub and Bluesky (28 times).
On GitHub · 27
- May 13, 2020[RFC] Add tar-based IterableDataset implementation to PyTorch — pytorch/pytorch87 reactions · 32 comments
- Apr 28, 2021WebDataset.jl, a linearly scalable data loader based on iterable datasets — FluxML/Flux.jl8 reactions · 4 comments
- Feb 22, 2025Add Timeout Option for Minikube Setup — medyagh/setup-minikube4 reactions · 2 comments
- Jul 28, 2020S3 ParseURI supporting query parameters — tensorflow/tensorflow2 reactions · 8 comments
- Oct 21, 2026Add affected Go package and range to GHSA-958w-8f9q-43j8 — github/advisory-database0 reactions
22 more on GitHub
- Oct 21, 2026Add affected Go package and range to GHSA-vcwj-2rq7-52fc — github/advisory-database0 reactions
- Oct 2, 2026chore: Upgrade AIStore Nix package to 1.5.1. — NVIDIA/multi-storage-client0 reactions · 1 comment
- Sep 23, 2026Add an AIStore-compatible GetBatch API for ML workloads — rustfs/rustfs0 reactions · 2 comments
- Aug 18, 2026fix: RangeReader returns 0 bytes when length is ContentLengthUnknown — andrewwhitecdw/aistore0 reactions
- Jul 14, 2026fix(msfs): interpret AIStore Atime as nanoseconds, not microseconds — NVIDIA/multi-storage-client0 reactions · 3 comments
- Jun 22, 2026fix: upgrade vulnerable dependencies from security scan — NVIDIA/multi-storage-client0 reactions · 1 comment
- May 5, 2026fix: upgrade vulnerable dependencies from security scan — NVIDIA/multi-storage-client0 reactions · 1 comment
- Apr 14, 2026extract: NVIDIA AIStore → infrastructure — TheunsBarnardt/ai-fdl-kit0 reactions · 1 comment
- Mar 12, 2026Add support for S3-compatible storage with HTTP redirects (e.g., NVIDIA AIStore) — mlcommons/storage0 reactions · 5 comments
- Jan 16, 2026v4.1.24 and v4.1.23: Reader returns wrapped `io.EOF` — pierrec/lz40 reactions · 2 comments
- Jan 15, 2026logsDir other than "/var/log/ais" does not work — NVIDIA/ais-k8s0 reactions · 5 comments
- Jan 14, 2026redirection doesn't work in put request — apache/arrow-rs-object-store0 reactions · 3 comments
- Dec 16, 2025Add Native AIStore Storage Support — argonne-lcf/dlio_benchmark0 reactions · 2 comments
- Dec 3, 2025modernize and revive linters reports — golangci/golangci-lint0 reactions · 5 comments
- Jul 14, 2025panic: close of closed channel — golangci/golangci-lint0 reactions · 5 comments
- Apr 28, 2024services: Add NVIDIA/aistore support — apache/opendal0 reactions · 3 comments
- May 11, 2023Modify the resource limit: memory limit from 30Mi to 100Mi — NVIDIA/ais-k8s0 reactions · 1 comment
- Sep 16, 2022Failing AIStore CI — meta-pytorch/data0 reactions · 2 comments
- Jun 14, 2022AIStore Datapipes (AISFileListerIterDataPipe and AISFileLoaderIterDataPipe) — meta-pytorch/data0 reactions · 7 comments
- Feb 9, 2022[INTEGRATION] with AiStore — activeloopai/deeplake0 reactions
- Dec 23, 2021AIStore example added — activeloopai/examples0 reactions · 1 comment
- Dec 17, 2021AIStore — gaow0007/code-reading0 reactions
On Bluesky · 1
- Dec 14, 2025Never really enjoyed working with minio. Looks like nvidia has a higher performing alternative (also in go). Minio never supported erasure… — @taras.glek.net2 likes and reposts
Where files are headingNew AGENTS.md files have more rules about keeping secrets out of the code, and fewer about code style.
Of the AGENTS.md files we read, the 28,693 first seen in the last six months, against the older ones: the kind of rule that gained most share, and the kind that lost most. About files like this in general, not this one, and an estimate, since a kind is a pattern in the words.
In this repository3 other files it gives its agents.
- cmd/cli/AGENTS.mdAGENTS.md
- cmd/ishard/AGENTS.mdAGENTS.md
- docs/llms.txtllms.txt
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

