agentleFS
ufukyuksel-devufukyuksel-dev/SUPER_COMPUTER_AI/skills/ai-engineering/ai-system-design/SKILL.md

ai-system-design

Skill0 starsChanged 48 days agoMITView on GitHub

Use when scoping, architecting, or planning an AI system or feature — requirements intake, capability gap-scan, option comparison, architecture decisions, plan and acceptance-criteria production. Top-level orchestrator for project-scale requests: composes multiple specialist skills as needed. Runs the core loop: analyze, resolve unknowns via skill ai-research, gap-scan the capability matrix, compare options, design, define eval, then verify via skill implementation-verification when available, else an inline verification checklist. Do NOT use for executing research itself or for picking a specific model (see skill model-selection-hf).

2 other projects use a version of this.

Adopted by

Most recently taken up by

The file

Show its rules and text

We split this skill into the rules it gives an agent

13 rules. About 0 are common, 12 are distinctive, and 1 is very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈12

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 1

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Do not perform current-fact research.

    line 11
  2. Distinctive:

    Do not choose a concrete model.

    line 12
  3. Distinctive:

    Ask narrowly about decision-changing ambiguity.

    line 14
  4. Distinctive:

    Verify: After implementation exists, see skill implementation-verification and invoke it with the acceptance criteria, evaluation gates, …

    line 24
  5. Distinctive:

    Create one node per concern, not one node per project.

    line 28
  6. Distinctive:

    Add edges for real information dependencies.

    line 29
  7. Distinctive:

    Run independent nodes in parallel, such as data/privacy analysis, model research, RAG design, serving analysis, and evaluation design when …

    line 30
  8. Distinctive:

    Keep specialist content in its owner.

    line 31
  9. Distinctive:

    Use the following ownership boundaries:

    line 34
  10. Distinctive:

    Put evidence before claims.

    line 62
  11. Very specific:

    If a specialist skill or tool is unavailable, keep its concern as an explicit DAG node, record required inputs and outputs, and mark its …

    line 68
  12. Distinctive:

    If authoritative requirements or evidence remain unavailable after the ambiguity limit, pause that decision and ask the human one narrow …

    line 69
  13. Distinctive:

    If implementation cannot be executed, do not claim verification.

    line 70

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

AI System Design

Boundaries

  • Orchestrate project-level scoping and design; assign one specialist skill to each concern and use as many concerns as the project requires.
  • Do not perform current-fact research. For bounded fact questions, see skill ai-research and integrate its cited findings.
  • Do not choose a concrete model. After recording task, modality, license, hardware, and budget constraints, see skill model-selection-hf.
  • Produce decisions, architecture, an ordered implementation plan, acceptance criteria, and an evaluation plan. Do not implement unless the human separately asks for implementation.
  • Ask narrowly about decision-changing ambiguity. After at most two focused ambiguity passes, stop and ask the human rather than inventing business meaning, capacity, or trust boundaries.

Decision Workflow

  1. Analyze. Complete the intake checklist. Emit an intake brief containing intended outcome, knowns, constraints, assumptions, unknowns, and narrow questions.
  2. Resolve unknowns. Separate requirements ambiguity from current-fact gaps. Ask the human about the former; for the latter, see skill ai-research and send bounded tasks. Record sources and mark unresolved facts UNVERIFIED.
  3. Gap-scan. Copy the capability matrix. Mark every row required, unnecessary — <rationale>, or unresolved — <question>. Do not omit a row because it looks unrelated.
  4. Compare. For each decision, enumerate viable options and evaluate evidence, constraints, trade-offs, risks, cost, reversibility, and rejected alternatives. Use the architecture decision template.
  5. Design. Define components, interfaces, data flow, trust and egress boundaries, failure behavior, ownership, and specialist decisions. Distinguish verified facts, estimates, assumptions, and decisions.
  6. Plan and evaluate. Produce dependency-ordered implementation slices, measurable acceptance criteria, and an evaluation plan. For metric and dataset design, see skill eval-harness. Include rollback or stop gates for risky changes.
  7. Verify. After implementation exists, see skill implementation-verification and invoke it with the acceptance criteria, evaluation gates, deliverable, environment, and known risks. Integrate its direct evidence and preserve every FAIL or UNVERIFIED result.

Composition DAG

  1. Create one node per concern, not one node per project. Assign the most specific owning skill from the capability matrix.
  2. Add edges for real information dependencies. Typical prerequisites include research before evidence-dependent choices, model selection before hardware tuning, architecture before implementation, and implementation before verification.
  3. Run independent nodes in parallel, such as data/privacy analysis, model research, RAG design, serving analysis, and evaluation design when their inputs are already known.
  4. Keep specialist content in its owner. Pass compact contracts between nodes: inputs, assumptions, decisions, evidence, outputs, and unresolved items.
  5. Reconcile conflicts explicitly and integrate accepted outputs into one architecture and ordered plan. Do not paste disconnected specialist reports.

Use the following ownership boundaries:

  • For current facts and unfamiliar-domain mapping, see skill ai-research.
  • For concrete model and Hugging Face decisions, see skill model-selection-hf.
  • For VRAM, quantization, KV-cache, batching, and decode tuning, see skill inference-optimization.
  • For engine, serving topology, scaling, and serving-time routing, see skill model-serving.
  • For dataset and adaptation lifecycle, see skill training-peft.
  • For metrics, eval data, judging, and comparison significance, see skill eval-harness.
  • For retrieval, chunking, embeddings, stores, reranking, and RAG evaluation, see skill rag-engineering.
  • For prompts, context budgets, memory, and compaction, see skill context-engineering.
  • For tools, MCP, plugins, skills, subagents, hooks, and harness integration, see skill tool-and-mcp-design.
  • For deployed monitoring, drift, incidents, security posture, cost controls, and rollback, see skill production-ops.
  • For schedules, triggers, ingestion pipelines, approvals, and unattended guardrails, see skill ai-automation.
  • For end-to-end completion evidence, see skill implementation-verification.

Required Output

Return one integrated package:

  1. intake brief and unresolved questions;
  2. completed capability matrix;
  3. concern-to-skill DAG with parallel and sequential edges;
  4. option and architecture decision records with cited evidence;
  5. target architecture, interfaces, data/trust boundaries, and failure behavior;
  6. dependency-ordered implementation plan with owners and gates;
  7. measurable acceptance criteria and evaluation plan;
  8. verification mapping or UNVERIFIED labels for anything not exercised.

Put evidence before claims. Never turn an unsupported routing signal, remembered current fact, estimate, or unrun test into a pass.

Tool Requirements & Degradation

  • Require repository inspection tools for existing-system constraints and a planning surface for maintaining the DAG and evidence matrix.
  • For current facts, see skill ai-research and use its browsing protocol only; redact confidential inputs before any external call.
  • If a specialist skill or tool is unavailable, keep its concern as an explicit DAG node, record required inputs and outputs, and mark its decision or verification UNVERIFIED. Do not silently absorb specialist work or weaken its acceptance gate.
  • If authoritative requirements or evidence remain unavailable after the ambiguity limit, pause that decision and ask the human one narrow question. Continue only independent, reversible planning work.
  • If implementation cannot be executed, do not claim verification; provide the exact commands or probes still required.

Failure Modes

  • Treating one skill as sufficient for a multi-concern project.
  • Serializing every concern without a dependency reason or parallelizing nodes before their inputs exist.
  • Skipping matrix rows, especially security, cost, evaluation, operations, and automation.
  • Presenting traffic, data sensitivity, budget, provider behavior, or trust boundaries as known without evidence.
  • Recommending an option without alternatives, trade-offs, rejected choices, and measurable criteria.
  • Duplicating specialist guidance instead of defining and integrating its decision contract.
  • Implementing during a planning request or declaring completion from a plan, diff, or narrow test.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.