agent-scoping
Skill1 starsChanged 3 months agoMITView on GitHub
Use before building any AI agent or skill, or when the user says "should we build an agent for this", "can AI do this", "automate this workflow", "where should we use AI", "build me an agent". Decides what to build, what to refuse, and what to leave manual. Produces an agent brief with a success threshold and a kill criterion. Writes workspace/agents/<name>/brief.md. Scopes one agent. Not the org-level AI policy, data boundary, or readiness question, which is `ai-governance`.
In this repository25 other files it gives its agents.
- agent-guardrailsSkill
- agent-observabilitySkill
- agent-rolloutSkill
- ai-governanceSkill
- artifact-evalSkill
- attribution-architectureSkill
- context-portfolioSkill
- credit-and-cost-controlSkill
- data-hygieneSkill
- data-model-and-syncSkill
- enrichment-waterfallSkill
- eval-calibrationSkill
- eval-loopSkill
- eval-spec-authoringSkill
- gtm-systems-auditSkill
- icp-scoring-engineSkill
- lifecycle-and-routingSkill
- martech-stack-auditSkill
- ops-and-scale-osSkill
- reporting-architectureSkill
- signal-pipelineSkill
- skill-authoringSkill
- tam-and-sourcingSkill
- warehouse-and-pipesSkill
- writing-qualitySkill
The file
We split this skill into the rules it gives an agent
5 rules. About 0 are common, 4 are distinctive, and 1 is very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈4
Distinctive · estimate
This author's own choices. Worth a look.
1
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Very specific: line 28
Is there a written quality bar?: If nobody can say what good looks like, the agent cannot be evaluated, and unevaluated output gets trusted …
- Distinctive: line 48
When there is a list of possible builds, score each 1 to 10 on three dimensions, out of 30.
- Distinctive: line 79
Every scoping session should produce a short list of the things considered and refused, with reasons.
- Distinctive: line 89
Deterministic work is not an agent: Write a script
- Distinctive: line 93
Build on the third repetition,: not the first
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Agent Scoping
Decide what deserves to be built. Most requests for an agent should be answered with a different agent, a fix upstream, or nothing.
When to use
- Somebody asks for an agent, a skill, or an automation
- Planning an AI roadmap for a GTM team
- A previous build failed and the next one is being scoped
Inputs
- Reads:
workspace/audit/systems-audit.md - Needs from user: the task in the form of what a person does today, how often, how long it takes, what a bad output costs, and who would use it
Workflow
1. Run the refusal test first
Four questions. A no on any of them means do not build it yet, and say why.
Is the input reliable? An agent on top of a broken data layer produces confident, well-written, wrong output faster than a human could. If the audit put the data plane below 3, fix that first. This is the most common reason to refuse.
Is there a written quality bar? If nobody can say what good looks like, the agent cannot be evaluated, and unevaluated output gets trusted by default. Write the rubric first. See eval-spec-authoring.
Is the task repeated? Under roughly weekly, and the maintenance cost exceeds the saving. Do the thing manually.
Is somebody accountable for using it? Not "the team would benefit." A named person whose work changes. Without one, adoption will be near zero regardless of quality.
2. Classify the work, because the class determines the build
| Class | Characteristics | Build as | Expected correction rate |
| Deterministic pipeline | Fixed rules, no judgment | Not an agent. A script or a no-code flow | Near zero |
| Retrieval and assembly | Gather, structure, summarize | Skill. The best fit for agents | Under 20% |
| Judgment with a rubric | Score, qualify, review | Skill plus an independent judge | 20 to 40% |
| Generative with voice | Write in somebody's voice | Skill plus context portfolio plus eval loop | 30 to 50% |
| High-stakes irreversible | Sends, spends, or writes to a system of record | Agent drafts, human approves. Never autonomous | Human gate, always |
The last row is a rule, not a preference. Anything that sends an email, spends money, or writes to the CRM gets a human approval step until it has a long track record.
3. Score the candidates
When there is a list of possible builds, score each 1 to 10 on three dimensions, out of 30.
| Dimension | The question |
| Impact | Hours saved per week, or quality lift on something that matters |
| Confidence | How sure are we this works, given the data and the quality bar |
| Ease | Build plus maintenance plus rollout, honestly |
Highest total wins. The confident thing you can ship this month usually beats the ambitious thing nobody will maintain. Ease is where teams lie to themselves, because it is scored on build time and paid on maintenance time.
4. Write the brief
AGENT / SKILL: <name>
The task today: <what a person does, step by step>
Frequency: <per week>
Time now: <minutes per run>
Class: <from the table above>
Reads from: <context portfolio modules, data files, systems>
Guardrails: <spend, conflict checks, refusals, escalation>
Human gate: <where, or explicitly none and why>
Success threshold: <measurable, e.g. correction rate under 30% at week 4>
Kill criterion: <what makes us stop, stated now>
Accountable user: <name>
Owner: <name>The kill criterion is the field that matters most and the one always left blank. Without it, a failing agent stays in the repo forever because nobody has authority to remove it. Write it before building, when you are still honest.
5. Name what you are not building
Every scoping session should produce a short list of the things considered and refused, with reasons. It stops the same request arriving three more times, and it is the most reused artifact from this skill.
Output
- Writes:
workspace/agents/<name>/brief.md - Uses:
templates/agent-brief-template.md - Prints: the refusal test results, the class, the score if there were candidates, the brief, and the not-building list
Rules & quality bar
- Refusal test before anything else. A no is a valid and common output
- Never build on a data plane scored under 3. Route to the data layer and say so
- Deterministic work is not an agent. Write a script
- Anything that sends, spends, or writes to a system of record gets a human gate
- Kill criterion is mandatory, written before the build
- A named accountable user, or do not build
- Build on the third repetition, not the first
Related skills
- Requires:
gtm-systems-auditfor the data plane score - Hands off to:
context-portfolio, thenskill-authoring, thenagent-guardrails - See also:
docs/build-surface.mdfor choosing the primitive
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

