agentleFS
5uck1ess5uck1ess/devkit/skills/autoloop/SKILL.md

autoloop

Skill4 starsChanged 4 months agoMITView on GitHub

Autonomous improvement loop inspired by karpathy/autoresearch — use when asked to run an autoloop, auto loop, autonomous improvement, or run experiments overnight on the codebase.

2 other projects use a version of this.

Adopted by

Most recently taken up by

The file

Show its rules and text

We split this skill into the rules it gives an agent

14 rules. About 0 are common, 8 are distinctive, and 6 are very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈8

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 6

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Very specific:

    Use AskUserQuestion to gather these inputs.

    line 12
  2. Distinctive:

    Ask: "What do you want to improve?

    line 16
  3. Very specific:

    Ask: "What command measures success?

    line 20
  4. Distinctive:

    If the user doesn't have one, detect the stack and suggest:

    line 22
  5. Distinctive:

    If not obvious from the metric, ask: "Is higher or lower better for this metric?"

    line 37
  6. Distinctive:

    Ask: "How many improvement cycles?

    line 41
  7. Very specific:

    Ask: "Any scope constraints?

    line 45
  8. Distinctive:

    If the user says "everything" or skips, leave scope open.

    line 47
  9. Very specific:

    Start the workflow via the devkit engine:

    line 51
  10. Very specific:

    Use the devkit_start tool with workflow: "autoloop" and input: "{input}".

    line 55
  11. Distinctive:

    Never skip the measurement step — every change must be measured

    line 61
  12. Distinctive:

    Never keep a change that regressed the metric — always revert

    line 62
  13. Very specific:

    Use the scratchpad (.devkit/scratchpads/current.md) to avoid repeating failed approaches

    line 64
  14. Distinctive:

    Stop when budget is exhausted, iterations are done, or metric stops improving

    line 65

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Autoloop

Autonomous codebase improvement inspired by karpathy/autoresearch. Audit the codebase, pick the highest-impact change, fix it, measure the result, keep or revert, repeat.

Before Starting

Use AskUserQuestion to gather these inputs. Do NOT proceed without answers.

1. Objective

Ask: "What do you want to improve? (e.g., test coverage, lint errors, performance, security)"

2. Metric Command

Ask: "What command measures success? (e.g., go test -cover ./..., npx jest --coverage, ruff check . | wc -l)"

If the user doesn't have one, detect the stack and suggest:

StackDefault metricDirection
Gogo test -cover ./...higher-is-better (coverage %)
TypeScriptnpx jest --coveragehigher-is-better (coverage %)
Pythonpytest --covhigher-is-better (coverage %)
Rustcargo testhigher-is-better (pass count)
Go (lint)go vet ./... 2>&1 | wc -llower-is-better (error count)
Any (lint)<linter> . 2>&1 | wc -llower-is-better (error count)

Confirm with the user: "I'll use <command> with <direction>. Correct?"

3. Direction

If not obvious from the metric, ask: "Is higher or lower better for this metric?"

4. Iterations

Ask: "How many improvement cycles? (default: 10, max recommended: 50)"

5. Scope (optional)

Ask: "Any scope constraints? (e.g., only src/engine/, only .py files, or everything)"

If the user says "everything" or skips, leave scope open.

Invoke the Workflow

Start the workflow via the devkit engine:

Assemble the input as a single string: "<objective> | metric: <command> | direction: <higher/lower>-is-better | iterations: <N> | scope: <constraint or 'all'>".

Use the devkit_start tool with workflow: "autoloop" and input: "{input}".

Then follow each step the engine returns. Call devkit_advance after completing each step. The engine controls step order, gates, and loops. Do NOT skip steps.

Rules

  • Never skip the measurement step — every change must be measured
  • Never keep a change that regressed the metric — always revert
  • One hypothesis at a time — don't bundle changes
  • Use the scratchpad (.devkit/scratchpads/current.md) to avoid repeating failed approaches
  • Stop when budget is exhausted, iterations are done, or metric stops improving
  • Be honest in the report — include reverted attempts, not just successes

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.