agentleFS
DROOdotFOODROOdotFOO/agent-skills/skills/rag-architect/SKILL.md

rag-architect

Skill1 starsChanged 2 months agoMITView on GitHub

Design RAG pipelines with informed chunking, embedding, retrieval, and evaluation decisions. TRIGGER when: user asks about RAG pipeline design, chunking strategies, embedding models, vector databases, or retrieval-augmented generation. DO NOT TRIGGER when: user asks about fine-tuning, prompt engineering without retrieval, or general LLM usage.

We split this skill into the rules it gives an agent

1 rule. 0 are common, 1 is distinctive, and 0 are very specific to this project.

  • 0

    Common

    Most of the 21 edited versions we read keep these.

  • 1

    Distinctive

    This author's own choices. Worth a look.

  • 0

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Start simple -- fixed-size chunks + dense retrieval is a valid baseline

    line 51

“Common” is measured: kept by at least 6 in 10 of the 21 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

RAG Architect

Design retrieval-augmented generation pipelines with the right tradeoffs at each layer.

Workflow

  1. Choose chunking strategy -- Match chunk method to document structure
  2. Select embedding model -- Balance dimensions, speed, and domain fit
  3. Choose vector DB -- Match scale, features, and deployment model
  4. Design retrieval -- Dense, sparse, hybrid, or reranked
  5. Evaluate -- Measure faithfulness, relevance, and answer quality

Reading Guide

DecisionFile
Chunking strategies + embedding modelschunking-and-embedding.md
Retrieval strategies + vector DBs + evaluationretrieval-and-evaluation.md

Quick Decision Matrix

Document typeChunkingEmbeddingRetrieval
CodeSemantic (AST-aware)Code-specializedHybrid + rerank
Legal/medicalDocument-aware (sections)Domain-specificDense + rerank
Chat logsSentenceGeneral-purposeDense
Technical docsRecursiveGeneral-purposeHybrid
Mixed/unknownRecursive (fallback)General-purposeHybrid + rerank

What You Get

  • A RAG pipeline architecture specifying chunking strategy, embedding model, vector store, and retrieval method for your document types
  • Concrete configuration recommendations (chunk size, overlap, dimensions, top-k) with rationale for each tradeoff
  • An evaluation plan using RAGAS or equivalent metrics to validate retrieval quality before and after tuning

Rules

  1. Start simple -- fixed-size chunks + dense retrieval is a valid baseline
  2. Measure before optimizing -- run RAGAS evaluation before adding complexity
  3. Chunk overlap matters -- 10-20% overlap prevents context loss at boundaries
  4. Embedding dimensions are a tradeoff -- higher is not always better (cost, latency)
  5. Hybrid retrieval (dense + sparse) almost always beats either alone

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

Reviews can't be read right now.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.