agentleFS
HeyvhuangHeyvhuang/ship-faster/skills/skill-evolution/SKILL.md

skill-evolution

Skill337 starsChanged 10 months agoMITView on GitHub

Global evolution system for ship-faster skills. Uses hooks to capture context, failures, and session summaries, then generates patch suggestions (no auto edits) via skill-improver. Use when you want the skills to self-improve safely and continuously.

12 other projects use a version of this.

Adopted by

Most recently taken up by

The file

We split this skill into the rules it gives an agent

11 rules. 0 are common, 5 are distinctive, and 6 are very specific to this project.

  • 0

    Common

    Most of the 8 edited versions we read keep these.

  • 5

    Distinctive

    This author's own choices. Worth a look.

  • 6

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Default hooks can only "log events" without automatically consolidating experience into skills.

    line 12
  2. Very specific:

    When user chooses "yes to optimize", use skill-improver to generate minimal patch suggestions based on real run artifacts (still no …

    line 16
  3. Very specific:

    Use skill-improver to propose a minimal patch

    line 22
  4. Distinctive:

    Add to your global settings (or project settings) so hooks run automatically.

    line 29
  5. Very specific:

    When you have just completed a "deliverable big task" (e.g., you have already written final.md or filled the run’s tasks.md Delivery …

    line 137
  6. Distinctive:

    Do you want to optimize skills based on this run?

    line 141
  7. Very specific:

    If user chooses 1A: Immediately run skill-improver, only give run_dir path as input (don't paste logs into conversation)

    line 161
  8. Very specific:

    If user chooses 1B: Write "blocker + desired optimization direction" to evolution-review.md (or corresponding workflow run's final.md / …

    line 162
  9. Distinctive:

    If user chooses 1C: Don't interrupt, just end (but still keep run artifacts for future retrospectives)

    line 163
  10. Very specific:

    If user chooses to evolve: run skill-improver with the best run_dir (the workflow run_dir is usually better than evolution run_dir).

    line 178
  11. Distinctive:

    No skills are edited automatically.

    line 193

“Common” is measured: kept by at least 6 in 10 of the 8 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Evolution

This skill makes the skills library evolve based on real development signals without auto-editing skills. The default output is a patch suggestion only.

Why it exists (solving "too passive")

Default hooks can only "log events" without automatically consolidating experience into skills.

The goal of this skill is to turn retrospectives into a fixed closing action:

  • At the end of each "big task", spend 60 seconds on Q&A confirmation: whether to optimize skills and which areas to prioritize
  • When user chooses "yes to optimize", use skill-improver to generate minimal patch suggestions based on real run artifacts (still no auto-editing of skill library)

Default strategy

  • Capture context and failures into run artifacts
  • Generate evolution candidates
  • Use skill-improver to propose a minimal patch
  • Human reviews and applies the patch

Global hooks (recommended)

Hooks live in: ~/.claude/skills/skill-evolution/hooks/

Add to your global settings (or project settings) so hooks run automatically.

Example (merge into ~/.claude/settings.json or <project>/.claude/settings.json):

Evolution settings

Configure behavior via ~/.claude/skills/skill-evolution/hooks/settings.json:

{
  "min_fail_count": 2,
  "ignore_tool_errors": true,
  "noise_filters": {
    "ignore_patterns": [
      "typescript: type.*already exists",
      "eslint:.*no-unused-vars.*react",
      "prettier:.*prettier-ignore"
    ],
    "max_failures_per_run": 20,
    "recent_only": true,
    "recent_window_minutes": 60
  },
  "output_format": {
    "summary_only": false,
    "include_context": true,
    "include_recent_failures": 20,
    "sort_by": "frequency"
  }
}

Settings explanation:

  • min_fail_count: Minimum occurrences of a single error type before generating a candidate
  • ignore_tool_errors: Whether to ignore tool-level errors (vs user code errors)
  • noise_filters.ignore_patterns: List of regex patterns to ignore
  • max_failures_per_run: Maximum failures to record per session (prevent explosion)
  • recent_only: Only look at failures within recent time window
  • recent_window_minutes: Only count failures within the last N minutes
  • output_format: Controls evolution-candidates.md output format
{
  "hooks": {
    "PreToolUse": [
      {
        "matcher": "Bash|Write|Edit",
        "hooks": [
          {
            "type": "command",
            "command": "bash ~/.claude/skills/skill-evolution/hooks/pre-tool.sh"
          }
        ]
      }
    ],
    "PostToolUse": [
      {
        "matcher": "Bash",
        "hooks": [
          {
            "type": "command",
            "command": "bash ~/.claude/skills/skill-evolution/hooks/post-bash.sh \"$TOOL_OUTPUT\" \"$EXIT_CODE\""
          }
        ]
      },
      {
        "matcher": "Write|Edit",
        "hooks": [
          {
            "type": "command",
            "command": "bash ~/.claude/skills/skill-evolution/hooks/post-tool.sh \"$TOOL_OUTPUT\" \"$EXIT_CODE\""
          }
        ]
      }
    ],
    "Stop": [
      {
        "matcher": "",
        "hooks": [
          {
            "type": "command",
            "command": "bash ~/.claude/skills/skill-evolution/hooks/session-end.sh"
          }
        ]
      }
    ]
  }
}

Run artifacts

Hooks write to project-local run folders:

<project-root>/runs/evolution/<run_id>/
  logs/
    events.jsonl
    failures.jsonl
    state.json
    context.json
  evolution-candidates.md
  evolution-review.md

run_id is stored in <project-root>/runs/evolution/.current so all hooks in a session write to the same run.

Evolution checkpoint (default action at end of big tasks)

When you have just completed a "deliverable big task" (e.g., you have already written final.md or filled the run’s tasks.md Delivery summary), you must do a brief retrospective when closing, and give the choice to the user.

In the conversation, ask only 3 questions (prefer multiple choice to reduce cost):

  1. Do you want to optimize skills based on this run?
    • A. Yes, propose a patch now (recommend using skill-improver first to generate minimal patch)
    • B. Record the issue first, optimize later
    • C. Not needed
  2. What was the biggest blocker this time?
    • A. Missing input/context fields (need clearer I/O contracts)
    • B. Unclear plan/granularity too large (need to split or clarify validation steps)
    • C. Environment/dependency/command issues (need scripting or fixed commands)
    • D. UI/design iterations (need clearer design-system or UI subtask splitting)
    • E. External service/permissions/configuration (need clearer confirmation points and verification)
    • F. Other (explain in one sentence)
  3. Which direction do you want to prioritize for optimization?
    • A. I/O contracts: Fix artifact names, fields, paths
    • B. Index/summary: Less context, better resume navigation (proposal/tasks)
    • C. Scripts/templates: Turn repetitive steps into deterministic scripts
    • D. Confirmation points: Reduce risky actions, confirm earlier/more clearly

Execution rules:

  • If user chooses 1A: Immediately run skill-improver, only give run_dir path as input (don't paste logs into conversation)
  • If user chooses 1B: Write "blocker + desired optimization direction" to evolution-review.md (or corresponding workflow run's final.md / tasks.md), process collectively next time
  • If user chooses 1C: Don't interrupt, just end (but still keep run artifacts for future retrospectives)

When to evolve (Ship Faster focus)

  • Next.js upgrade or migration issue solved
  • Guardrails problem fixed (lint/typecheck/build)
  • Supabase error or migration pattern learned
  • Stripe setup or billing flow resolved
  • Vercel deploy or GitHub CI issue resolved
  • AI SEO setup or indexing issue solved

How to evolve

  1. Hooks create evolution-candidates.md + evolution-review.md with the latest signals.
  2. At the end of a big task, ask the 3 checkpoint questions (above) and let the user decide.
  3. If user chooses to evolve: run skill-improver with the best run_dir (the workflow run_dir is usually better than evolution run_dir).
  4. Apply the patch manually and re-validate skills.

Example event

{"ts":"2026-01-11T12:00:00Z","event":"post-bash","category":"build","exit_code":1,"summary":"next build failed: Module not found","artifacts":["logs/failures.jsonl"]}

Outputs

  • evolution-candidates.md (auto-generated)
  • evolution-review.md (auto-generated, includes the 3 questions)
  • Suggested patch from skill-improver (manual apply)

No skills are edited automatically.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.