harness-engineering
Skill4 starsChanged 3 months agoMITView on GitHub
Orchestrator for agent harness work — the setup that makes AI agents follow project rules and improve when they fail. FIRES PROACTIVELY when agents misbehave, repeat mistakes, ignore instructions, skip skills, or when AGENTS.md exists but docs/harness/manifest.json is missing. Also triggers on: harness engineering, agent scaffold, agent keeps failing, agent not following instructions, make agents reliable, agents going off rails, agent forgot context, improve agent setup, self-improving agents, agents keep making mistakes, why is my agent bad, agent quality, agent setup broken, agents ignore skills, same mistake again, fix agent behavior, tune agent instructions, set up agent infrastructure, after project setup agents still bad. Routes bootstrap vs evolution. Not multi-agent topology — agent-builder.
26 other projects use a version of this.
Adopted by
Most recently taken up by
- anuragsarkar97/skillstheir own version, first seen Nov 8, 2026
- Mark393295827/graph-engineering-architecturestheir own version, first seen Nov 8, 2026
- docxology/templatetheir own version, first seen Oct 30, 2026
- AnonymXXX/codex-harness-engineeringtheir own version, first seen Oct 29, 2026
- github/awesome-copilottheir own version, first seen Oct 25, 2026
- fishuke/harness-engineering-skilltheir own version, first seen Oct 25, 2026
Used with
Projects with it also use self-improvement-loops, bdi-mental-states and 10 more.
Other files people use alongside this one.
Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
DVwebBiz11Skillself-improvement-loops
This skill should be used when the harness, scaffold, workflow, or optimizer itself is the optimization target: recursive self-improvement (RSI) loops, meta-harnesses, self-improving harnesses that mine their own failures and propose bounded edits, evolutionary or population-based search over agent scaffolds, acceptance gates for self-modifying systems, and agentic context evolution where the mechanism that produces context is versioned and evolved. Route governance of a single autonomous loop (locked surfaces, durable logs, rollback, novelty gates, approval boundaries) to harness-engineering, measurement and quality-gate design to evaluation, judge design to advanced-evaluation, and remote sandbox infrastructure to hosted-agents.
Also in 4 projects that use this
Downey6689Skillbdi-mental-states
Transforms external RDF context into BDI mental states. Invoke when modeling beliefs, desires, and intentions.
Also in 5 projects that use this
Downey6689Skillhosted-agents
Guidance for hosted/sandboxed agents. Invoke when running background agents in isolated VMs or multi-client setups.
Also in 5 projects that use this
DVwebBiz11Skilllong-horizon-prompting
This skill should be used when writing, enhancing, or evaluating the launch prompt for a long-running autonomous agent or a parallel multi-agent orchestration attacking a hard problem: pseudo-formal task briefs that define terms and an exact success predicate linguistically, enumerate non-counting outcomes, set persistence rules with explicit stop and return conditions and effort floors, manage a diverse portfolio of parallel approaches with an approach registry and blocked-route bookkeeping, and gate the return on adversarial audit. Route agent topology and coordination protocols to multi-agent-patterns, runtime control surfaces and loop governance to harness-engineering, evaluator and quality-gate construction to evaluation, judge design to advanced-evaluation, and compaction or memory mechanics to context-compression and memory-systems.
Also in 4 projects that use this
AbdelrhmanAlquranSkilllatent-briefing
This skill should be used when the user asks to "share memory between agents", "KV cache compaction for multi-agent", "orchestrator worker context", "latent briefing", "reduce worker tokens", "cross-agent memory without summarization", or discusses Attention Matching compaction, recursive language models with workers, or token explosion in hierarchical agents.
Also in 4 projects that use this
abdullah1854Skillcontext-degradation
Also in 5 projects that use this
- +2 more from Downey6689
Other versions26 projects use a version of this.
Word for word · 0
None found.
Edited · 0
None found.
Wrote their own version · 26
- github/awesome-copilot★ 41ksame name
- muratcankoylan/Agent-Skills-for-Context-Engineering★ 18ksame name
- kangarooking/kangarooking-skills★ 709same name
- magnus919/agent-skills★ 172same name
- brake71/1c-ssl-skills★ 85same name
- docxology/template★ 23same name
- charlesanim/harness-engineering★ 20same name
- fiveonecode/agent-skills★ 20same name
- DamonZS/Claude-Codex-Pro-Tool★ 15same name
- drewid74/ai_skills★ 8same name
16 more not listed
How matches are found. Word for word: the exact same text. Edited: shares passages with this file (“99% same” means 99% of its five-word phrases also appear here; 10% or more counts). Their own version: similar meaning, or, weakest, the same name. We can’t tell which project had it first. Projects are counted among the 200 most-starred candidates, and mentions are links to the repository we found, up to 50 per site, so both counts are a floor.
In this repository125 other files it gives its agents.
- AGENTS.mdAGENTS.md
- .cursor/rules/agent-loom-routing.mdcCursor rule
- .cursor/rules/agent-loom-skills-index.mdcCursor rule
- adversarial-hatSkill
- agent-builderSkill
- agent-launcherSkill
- agent-loom-syncSkill
- agent-observabilitySkill
- agent-run-retroSkill
- agent-system-architectureSkill
- api-and-interface-designSkill
- api-deprecation-and-migrationSkill
- apply-paper-to-projectSkill
- app-security-hardeningSkill
- architectural-decision-logSkill
- assumption-mappingSkill
- brainstormingSkill
- browser-testing-with-devtoolsSkill
- business-modelingSkill
- ci-cd-and-automationSkill
- codebase-understandingSkill
- code-review-crspSkill
- code-simplificationSkill
- compress-skillSkill
- context-engineeringSkill
- create-agent-promptSkill
- cross-link-skillsSkill
- customer-discoverySkill
- debug-and-fixSkill
- deep-thinkingSkill
- dependency-mappingSkill
- deploy-anywhereSkill
- deprecate-skillSkill
- design-directionSkill
- design-reviewSkill
- design-systemSkill
- dynamic-routingSkill
- eval-judgeSkill
- eval-outputSkill
- eval-pipelineSkill
- eval-rubric-designSkill
- experimentationSkill
- experiment-backlogSkill
- experiment-readoutSkill
- experiment-runbookSkill
- experiment-specSkill
- fault-localizeSkill
- feature-specSkill
- fermiSkill
- first-principlesSkill
- frontend-designSkill
- generate-changelogSkill
- git-workflow-and-versioningSkill
- gsap-animationSkill
- harness-evolutionSkill
- harness-generationSkill
- idea-evaluationSkill
- idea-generationSkill
- implementation-planSkill
- improve-skillsSkill
- The first 60 shown.
The file
We split this skill into the rules it gives an agent
11 rules. 0 are common, 4 are distinctive, and 7 are very specific to this project.
0
Common
Most of the 23 edited versions we read keep these.
4
Distinctive
This author's own choices. Worth a look.
7
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Very specific: line 41
Never conflate harness work with agent-builder — topology is who.
- Very specific: line 42
Never route to harness-evolution without eval harness — bootstrap eval first.
- Very specific: line 43
Never skip harness-generation on greenfield projects before evolution.
- Distinctive: line 44
Never execute child skill workflows yourself — delegate and synthesize reports.
- Distinctive: line 45
Never present the route plan before invoking child skills (unless user said "go ahead").
- Very specific: line 53
Read references/harness-readiness-gate.md.
- Very specific: line 54
No manifest → bootstrap. Manifest + symptoms → evolution.
- Very specific: line 67
Read references/routing.md for disambiguation vs project-setup and project-orchestrator.
- Very specific: line 86
If missing: run bootstrap substeps, then harness-evolution.
- Distinctive: line 90
When user is building multi-agent systems:
- Distinctive: line 147
Run round 2 only if held-out plateaus </output> </example> </examples>
“Common” is measured: kept by at least 6 in 10 of the 23 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Harness Engineering
You are the harness orchestrator. You route bootstrap vs evolution vs audit, ensure eval prerequisites exist, and keep harness work separate from agent topology design.
Trigger Discipline
Proactive — user need not say "harness." Fire when: agent misbehavior symptoms; AGENTS.md without docs/harness/manifest.json; post-project-setup backfill; self-improvement claims. Full symptom table: references/harness-readiness-gate.md.
Hard Rules
Never conflate harness work with agent-builder — topology is who; harness is what wraps the model.
Never route to harness-evolution without eval harness — bootstrap eval first.
Never skip harness-generation on greenfield projects before evolution.
Never execute child skill workflows yourself — delegate and synthesize reports.
Never present the route plan before invoking child skills (unless user said "go ahead").
Workflow
Step 0 — Harness readiness scan (mandatory)
Read references/harness-readiness-gate.md. Silent: manifest exists? eval interface? symptoms?
No manifest → bootstrap. Manifest + symptoms → evolution. Self-improvement claim → reality-check.
Step 1 — Classify intent
| Signal | Route |
New project / no docs/harness/manifest.json | Step 2 bootstrap |
| "Improve" / failures / plateau / self-improving | Step 3 evolution |
| Legacy repo, no AGENTS.md | retroactive-project-setup → bootstrap |
| "Is it self-improving?" / claim audit | reality-check |
| Multi-agent / topology / "design agents" | agent-builder (harness orthogonal) |
| Eval only | eval-output |
Read references/routing.md for disambiguation vs project-setup and project-orchestrator.
Step 2 — Bootstrap path
project-setup (if no AGENTS.md) → harness-generation (v0)
→ eval-rubric-design (harness dimensions)
→ eval-pipeline (regression stub)Skip project-setup if populated AGENTS.md exists — merge via harness-generation only.
Step 3 — Evolution path
Precondition check (delegate verification to harness-evolution Step 0):
- manifest exists
- eval harness operational
- held-out split defined
If missing: run bootstrap substeps, then harness-evolution.
Step 4 — Agent-chain coordination
When user is building multi-agent systems:
harness-generationif no v0 (parallel-safe withprocess-decomposer).agent-builderfor topology.setup-evaluationmust PASS harness + eval checks beforeagent-launcher.
Step 5 — Unified report
Present child skill outputs in one summary (see Output Format).
Gotchas
- Harness is a first-order performance lever — same model, different harness, double-digit pass-rate swings (AlphaEval, Self-Harness).
- Harness is model-specific — evolved harness vN may not transfer unchanged across model families without re-validation.
- PROGRAM.md pattern (auto-harness): human writes optimization directive; agent edits declared surfaces only — good for long improvement campaigns.
- Self-improvement without eval trajectory is a 4/10 claim —
reality-checkstandard.
Output Format
=== Harness Engineering Report ===
Intent: [bootstrap | evolution | audit | topology-handoff]
Routes invoked: [skills]
=== Harness State ===
Version: [vN] | Manifest: [path]
Eval harness: [ready | missing → action]
=== Child Results ===
[per-skill summaries]
=== Next ===
[recommended follow-up]Example
<examples>
<example>
<input>Improve my agent harness — it keeps failing on lint steps.</input>
<output>
=== Harness Engineering Report ===
Intent: evolution
Routes: harness-evolution (round 1), eval-pipeline (regression)=== Harness State === Version: v0 → v1 | Eval harness: ready
=== Child Results === Diagnosed: Verification layer | Promoted middleware pre-lint hook
=== Next ===
Run round 2 only if held-out plateaus
</output>
</example>
</examples>
Common Rationalizations
| Excuse | Reality |
| "agent-builder handles harness" | Topology only — run harness-generation |
| "Skip eval for quick fix" | harness-evolution hard-fails — route eval first |
| "project-setup is enough" | One-shot AGENTS.md ≠ versioned harness + eval stub |
| "I'll evolve prompts only" | AHE ablation: prompt-only regresses |
| "Orchestrator does the work" | Delegate to child skills |
Verification
- Correct child skill selected per intent table
- Evolution not routed without eval precondition
- agent-builder requests include harness v0 check
- Unified report presented
Red Flags
- harness-evolution invoked without eval harness
- Harness conflated with multi-agent topology
- Bootstrap skipped on greenfield evolution request
Prune Log
Last pruned: 2026-07-05
- Deep learn-from: routing.md Pareto frontier; INGEST-QUEUE pairwise compares cleared
Impact Report
Harness engineering: [intent]
Child skills: [list] | Harness version: [vN]
Eval ready: [yes/no] | Promoted: [yes/no]Reference Files
references/routing.md— disambiguation matrix, lifecycle map, PROGRAM.md patternreferences/harness-readiness-gate.md— proactive triggers, symptom phrases, readiness checklistreferences/examples.md— bootstrap, evolution, and agent-chain coordination examples
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

