agentleFS
metratonmetraton/gaia/skills/gaia-audit/SKILL.md

gaia-audit

Skill4 starsChanged 5 months agoMITView on GitHub

Use when the user asks to audit, check, or review a Gaia component (an agent or a skill) against its standard and its live implementation -- "audita este skill", "chequea este agente", "¿está bien esta skill con la implementación?", "¿cómo mejoro este agente?

1 other project uses a version of this.

Adopted by

Most recently taken up by

The file

We split this skill into the rules it gives an agent

3 rules. About 0 are common, 2 are distinctive, and 1 is very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈2

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 1

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Factual drift is a fix; judgment trim is a discussion: When the code rejects what the component claims, that is factual drift -- propose …

    line 38
  2. Very specific:

    Use this on a single named component.

    line 45
  3. Distinctive:

    Re-teaching the type standard: If the audit explains what a good skill or agent is, it is duplicating the creator.

    line 131

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Gaia Audit

The discipline for auditing one Gaia component -- an agent or a skill -- against its type standard AND the live implementation it describes, and returning an enumerated proposal to discuss. The user reaches for this when they point at a single component and ask "how do I improve this? is it still right with the implementation?". The audit reads; it proposes; it does not mutate. The orchestrator enumerates the proposal back to the user, who decides what lands.

Core principle

An audit is worthless if it grades the component against its own claims. The component is a declaration; the value of the audit is anchoring every claim to the implementation -- the actual files and symbols the component describes -- and surfacing where the two have drifted apart. Three forces shape it:

  • The standard is owned by the creator, not by this skill. What a good agent or skill looks like lives in agent-creation (for agents) and skill-creation (for skills). Load the creator for the component's type before judging it; this skill carries the audit cycle, not the type standard.
  • Claims anchor to symbols, or they are unverified. A reference to a field, module, table, or function is real only if it exists by that name in code (hooks/modules/security/approval_grants.py::activate_db_pending_by_id, hooks/modules/security/protected_paths.py::is_protected_hook_path), not by a line number that drifts on every edit. Hunt phantom references, dead instructions, and schema/contract drift by opening the implementation and matching symbol-for-symbol. Cover both single refs (the component to its own implementation) and cross refs (the component to its siblings).
  • Factual drift is a fix; judgment trim is a discussion. When the code rejects what the component claims, that is factual drift -- propose the correction. When the component is merely verbose, redundant, or could be tighter, that is a judgment call -- propose it as a discussion item, not a foregone fix. Keeping the two apart lets the user approve fast on facts and deliberate on taste.

Use this on a single named component. For validating the whole install pipeline (npm, dry-run, RC), that is gaia-verify. For deterministic structural checks -- name-vs-dir, dangling cross-ref -- defer to gaia doctor (see "Reference, do not duplicate").

For an explicit code review of a module, branch, or PR, use code-review. This skill retains agent/skill type-conformance and implementation-drift auditing; neither route applies its proposed corrections. In Gaia, carry the review artifact through the usual agent-protocol contract rather than replacing that envelope.

The audit cycle

  1. Identify the component and load its creator. Resolve which file is the target (an agent .md or a skill SKILL.md + reference.md). Load agent-creation if it is an agent, skill-creation if it is a skill -- that is the standard for its type and the source of the judgment you will apply.
  2. Validate the declaration against the implementation. Open the files and symbols the component names. Anchor each claim to a file + symbol. Hunt phantom references (named but absent), dead instructions (steps the code path no longer supports), and schema/contract drift (fields, tables, or envelope keys that have moved or renamed). Check single refs and cross refs to sibling components.
  3. Check how the component judges its own output. Find the step where it decides its output is done and name that judge: an instrument it runs, an independent verifier, the user, or itself. Flag a component whose only judge is itself (a closing reread, a self-review gate), one that reads a summary where a raw source is reachable, and an identity or step that opens with a role ("You are a ...", "act as ...") -- each against the creator rule it misses (agent-creation Step 2 Instruments and sources / Termination, skill-creation Step 3.5). Tag it factual-drift when the creator states the rule as required, judgment-trim otherwise.
  4. Enumerate what the component does TODAY. State, with key verbatim extracts, what the component currently declares and instructs. This is the baseline the proposal edits against -- ground it in the text, not in memory.
  5. Enumerate the drift. List every gap between the declaration and the implementation: what the code rejects, what is stale, what is missing. Each item names the claim, the symbol that contradicts it, and the direction of the drift.
  6. Propose changes. For each item, write the concrete change. Tag it factual-drift (the code disagrees -- a fix) or judgment-trim (tighter or leaner -- a discussion). The tag tells the user how much deliberation each item needs.
  7. Return for discussion. Hand the enumerated proposal back; the orchestrator presents it to the user. The audit ends here -- it does not apply edits.

Reference, do not duplicate

  • Creators own the type standard and the judgment. agent-creation and skill-creation define what good looks like per type. This skill invokes them; it does not restate their rules.
  • gaia doctor owns the deterministic checks. Mechanical, non-judgment checks -- name-vs-directory mismatch (check_component_naming, order 52) and dangling skill cross-ref (check_skill_cross_refs, order 53) -- live in gaia doctor, which runs them the same way every time. Do not re-run them inline here; run gaia doctor (or gaia doctor --json) for the structural pass and spend this skill's cycle on the judgment work the deterministic checks cannot do.

Output

An enumerated audit proposal, read-only: numbered drift items each tagged factual-drift or judgment-trim, with the anchoring file + symbol and the concrete proposed change. No file is mutated -- the audit proposes, the user disposes.

Anti-patterns

  • Auditing the component against its own claims. Grading the declaration by what it says about itself finds nothing. The whole value is anchoring to the implementation; an audit that never opens the code is a proofread, not an audit.
  • Anchoring to line numbers instead of symbols. A line range is stale the next edit; a symbol survives. A reference that cannot name the symbol it points to has not been verified.
  • Collapsing factual drift and judgment trim. Presenting a taste preference as a required fix erodes trust; presenting real drift as optional lets a broken claim survive. The tag is what lets the user approve fast and deliberate slow.
  • Applying the fix. This skill returns a proposal. The moment it edits the component, it has skipped the discussion the user asked for and taken a decision that was theirs.
  • Re-teaching the type standard. If the audit explains what a good skill or agent is, it is duplicating the creator. Load the creator and point at it; do not copy it.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.