create-ai-agent
Skill0 starsChanged 55 days agoMITView on GitHub
Operational recipe for BUILDING a new production AI agent, derived from the building-ai-agents-2026 field guide (18 AI Engineer 2026 talks). Load this skill whenever the user wants to create, scaffold, or architect a new agent, coding agent, agentic workflow, or "agent as a service." Produces a wired agent (skill files as employees, resolver/org chart, deterministic verification, save-button checkpoints, and a curated memory/brain) instead of a one-off prompt loop.
In this repository2 other files it gives its agents.
- templates/AGENTS.mdAGENTS.md
- <skill_name>Skill
The file
We split this skill into the rules it gives an agent
5 rules. About 0 are common, 3 are distinctive, and 2 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈3
Distinctive · estimate
This author's own choices. Worth a look.
2
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 46
Skillify, never one-off: When the agent does something well, turn it into a reusable skill.
- Very specific: line 60
Create the resolver table that routes incoming work to the right skill file / sub-agent, plus filing rules and a context budget.
- Very specific: line 78
Before any state-changing or risky action, checkpoint.
- Distinctive: line 94
Only add sub-agents, more skills, or autonomously-applied changes after the core earns trust.
- Distinctive: line 103
Run the scaffold script to generate the project skeleton, then fill in Steps 1–2 and 4–7:
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Create an AI Agent — the wiring recipe
Loads the principles from building-ai-agents-2026. This skill turns them into a
step-by-step build plus templates and a scaffold script so every new agent we
create is wired the same disciplined way.
Core reframe (hold this the whole time): a skill file is an employee, a resolver table is your org chart, an eval is a performance review, and the memory is your company brain. You are not writing a prompt — you are hiring and training a workforce out of markdown.
When to load this skill
- User says "build an agent", "create a bot", "scaffold an agent for X", "make an autonomous X", or any "agent as a service" request.
- You are about to add agentic behavior to an existing system and need structure.
- You catch yourself about to write a one-off
while trueloop with no verification.
Principles that must survive into the build (the "rules of the road")
- Latent vs deterministic. Mechanics, state, and verifiable computation → code/tools. Taste, vague-intent understanding, judgment → the model. Most bugs are computation on the wrong side.
- One capability = one skill file = one employee. Typed inputs, a verification step, and a rollback path. No side effects until validated.
- Verify deterministically where you can. Types (Pydantic), tests, simulators, ontology/reasoner. Don't let the loop verify itself with more LLM calls — that compounds error across iterations.
- The Save Button. Checkpoint a known-good state before any risky change; replay/ rollback on evidence (diff-decide).
- One strong loop beats a multi-agent committee. Split agents only when slices are truly isolated and you can scope their memory.
- Context engineering = which three books are open. Cap the "smart zone" (~60–100k tokens for hard problems, ≤200k even on 1M windows). Compaction is fine; curate the brain.
- Skillify, never one-off. When the agent does something well, turn it into a reusable skill. "If you ask twice, you failed."
- Start at 2–3x. Small, verified, human-in-the-architecture. Expand only after it earns trust. The 2X and 100X founders run the same model — wiring is the delta.
The build procedure (do these in order)
Step 1 — Write the mandate (one line, one job)
Name the agent and state its single capability in one sentence. If you need three sentences, you're describing three employees — split them now.
Step 2 — Draft AGENTS.md (the org chart)
Create the resolver table that routes incoming work to the right skill file / sub-agent, plus
filing rules and a context budget. Use templates/AGENTS.md as the skeleton.
- Resolver:
task type → skill file / sub-agent / tool - Filing rules: when does a result get written to the brain? who arbitrates contradictions?
- Context budget: max tokens per turn, what's hot (loaded) vs cold (retrieved) memory.
Step 3 — Split latent vs deterministic per task
For each task the agent does, decide what runs in code vs the model. Push anything mechanical, stateful, or verifiable into a tool or deterministic function. The model only does the human part (taste, judgment, vague intent).
Step 4 — Write at least one skill file per repeated task (the employees)
Each skill = one job, written clearly enough for an agent to execute. Use
templates/skill.md. Must include: typed inputs, the deterministic verification step, and a
rollback/checkpoint reference. The skill may edit itself ("update this file when you learn
something better").
Step 5 — Add the Save Button
Before any state-changing or risky action, checkpoint. Use templates/checkpoint.sh (or the
Python helper in scripts/). Capture a working snapshot so you can accept/revert on evidence.
Step 6 — Wire verification (deterministic + agent-as-judge)
- Deterministic: types, unit tests, simulators, ontology/reasoner (RDFS/OWL) catch contradictions (e.g. second refund on one order, payout to wrong entity, impossible status).
- Agent-as-judge: run on live traces to catch trajectory-level failure (loops calling the
same tool forever, inefficient paths, silent context loss). Use
templates/eval-checklist.md.
Step 7 — Build the brain (memory + hygiene)
Set up the memory store with: provenance on every fact, contradiction checks on collision, and a
librarian (human + agent) whose job is pruning. Retrieval is easy; being worth retrieving from
is the product. Use templates/brain.md.
Step 8 — Start small, verify, expand
Ship one strong loop with deterministic verification and a human in the architecture. Run at 2–3x. Only add sub-agents, more skills, or autonomously-applied changes after the core earns trust.
Step 9 — Skillify the process
Turn this scaffolding into a reusable asset (this skill). Whenever you build a second agent, reuse the templates; adapt, don't restart.
Quick scaffold (recommended)
Run the scaffold script to generate the project skeleton, then fill in Steps 1–2 and 4–7:
python "C:/Users/ratin/AppData/Local/hermes/skills/create-ai-agent/scripts/scaffold_agent.py" \
--name "support-triage-agent" \
--purpose "Triage incoming support threads, route to owners, draft replies." \
--dir "./agents"It creates AGENTS.md, skills/, brain/, evals/, goal.md, and a .checkpoint/
helper, pre-filled from the templates. On this Windows box use python (not uv run python3).
Anti-patterns to refuse
- A
while trueloop with no verification and no checkpoint. - Letting the agent verify its own work with more LLM calls.
- Putting stateful computation in the model's context instead of code.
- A multi-agent committee where one wired loop would do.
- Dumping into memory with no provenance/pruning (confident-wrong garbage dump).
- Assuming alignment/safety comes from the model — it comes from the infrastructure.
Source
Distilled from building-ai-agents-2026 (18 AI Engineer 2026 talks). Per-talk crux:
~/AppData/Local/hermes/skills/building-ai-agents-2026/references/crux-18-talks.md.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

