agentleFS
tatashbartatashbar/Economic-Modeling-Studio/.agents/skills/build-llm-agents/SKILL.md

build-llm-agents

Skill4 starsChanged 6 days agoMITView on GitHub

Builds LLM-agent economic simulations (synthetic households, firms, forecasters, negotiators) with sensitivity and human-data checks.

The file

We split this skill into the rules it gives an agent

9 rules. About 0 are common, 7 are distinctive, and 2 are very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈7

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 2

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Very specific:

    If a required input is ABSENT, that part is NOT ASSESSED — NO DATA: do not estimate or invent it.

    line 26
  2. Very specific:

    Collaboration: Follow .claude/docs/collaboration-protocol.md: ask questions first, present options, get approval before writing files, and …

    line 28
  3. Distinctive:

    Use structured outputs; record prompts and versions

    line 48
  4. Distinctive:

    Run pilot simulations across prompts, seeds and at least two LLMs

    line 49
  5. Distinctive:

    Check for contamination from well-known published experiments

    line 52
  6. Distinctive:

    Document reproducibility details (model versions, temperature, seeds)

    line 54
  7. Distinctive:

    After the design: confirm personas and protocol

    line 57
  8. Distinctive:

    After pilots: confirm sensitivity is acceptable before scaling

    line 58
  9. Distinctive:

    Before reporting: agree on the labeling of results

    line 59

≈ “Common” is an estimate: at least 1 in 5 of the 364,980 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md
<!-- Generated from .claude/skills/build-llm-agents/SKILL.md by tools/sync_agents.py. Edit the source, then run the script. -->

/build-llm-agents — Build LLM Agents

Category: Build (AI) · Primary agent: llm-agent-simulation-specialist

Builds LLM-agent economic simulations (synthetic households, firms, forecasters, negotiators) with sensitivity and human-data checks.

Arguments: whatever the user wrote after the command name.

Purpose

Build an economic simulation populated by LLM-powered agents (synthetic households, firms, forecasters or negotiators) and measure how much of what they do reflects stable behavior rather than prompt wording or model choice. The output is an exploratory simulation with sensitivity and reproducibility evidence, compared with human data wherever it exists.

Use it when piloting surveys or experiments, exploring expectation formation and reactions to communication, or prototyping behavioral rules for agent-based models.

Do not use it when results will be presented as evidence of human behavior without validation, or when a calibrated behavioral or agent-based model already answers the question (/build-abm).

Before you start

  1. Check required inputs. For each input below record FOUND or ABSENT (never 'assumed'):
    • Simulation design
    • Human data for calibration (if any) If a required input is ABSENT, that part is NOT ASSESSED — NO DATA: do not estimate or invent it; name what is missing and which skill produces it. If all required inputs are absent, stop and say so.
  2. Check confidentiality. Identify the data classification level of the inputs (.claude/docs/confidentiality-and-ai-use.md). Do not proceed with restricted or confidential data in a way the policy does not allow.
  3. Collaboration. Follow .claude/docs/collaboration-protocol.md: ask questions first, present options, get approval before writing files, and update production/session-state/active.md after each approved section.

Agents

  • llm-agent-simulation-specialist — primary agent; coordinates the work and integrates results
  • agent-based-modeling-specialist — Builds agent-based macro and financial models
  • multi-agent-rl-specialist — Builds multi-agent reinforcement learning systems for strategic economic interaction

Each agent is defined in .claude/agents/<name>.md. If your tool runs subagents, run these agents as subagents, in parallel where the steps are independent; otherwise read each agent's file and apply its instructions in turn. Subagents only write to the paths named in your instructions.

Key design decisions (present options, let the user choose)

DecisionTypical optionsWhat it changes
Personassurvey-grounded demographics, stylized typesRepresentativeness
Information and memoryfixed context, evolving memory, news feedsDynamics of beliefs
Protocolsurvey questions, market game, negotiationWhat is measured
Modelsat least two LLMs; versions pinnedModel dependence
Validation datahuman surveys, lab experimentsStrength of conclusions

Workflow

  1. Specify agent personas, information sets, memory and decision protocols
    • Use structured outputs; record prompts and versions
  2. Run pilot simulations across prompts, seeds and at least two LLMs
  3. Compare behavior to human experimental or survey evidence
    • Compare means, dispersion, treatment effects and heterogeneity
    • Check for contamination from well-known published experiments
  4. Quantify prompt and model sensitivity; label results exploratory unless validated
  5. Document reproducibility details (model versions, temperature, seeds)

Checkpoints with the user

  • After the design: confirm personas and protocol
  • After pilots: confirm sensitivity is acceptable before scaling
  • Before reporting: agree on the labeling of results

Common pitfalls

  • Treating simulated agents as representative humans
  • Results driven by one prompt wording
  • LLMs reciting famous experiments rather than behaving
  • Large simulated samples giving false precision

Output

models/llm/<name>-agents/

The folder holds persona and protocol definitions, prompts, run scripts, raw outputs, sensitivity analysis, the human-data comparison and a reproducibility record. Every run saves its results to output/<run-id>/ in the model folder, with a run log (.claude/rules/model-code.md).

Gate / verdict

  • Sensitivity across prompts and models reported
  • Output labelled exploratory unless validated against human data
  • Prompts, model versions, temperature and seeds are archived
  • Contamination risk is assessed

Suggested next steps

  • /ai-audit
  • /policy-simulation

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.