autoresearch
Skill776 starsChanged 2 months agoMITView on GitHub
Evolve a skill by generating variations, evaluating them, and updating the best version
- Commits and pushes
We split this skill into the rules it gives an agent
12 rules. 0 are common, 4 are distinctive, and 8 are very specific to this project.
0
Common
Most of the 87 edited versions we read keep these.
4
Distinctive
This author's own choices. Worth a look.
8
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Very specific: line 14
If ${var} is empty, abort with: "autoresearch requires var= set to a skill name" and exit.
- Very specific: line 16
Read memory/MEMORY.md for context.
- Very specific: line 26
Read skills/${var}/SKILL.md.
- Distinctive: line 38
Search the web for better approaches to what this skill does:
- Very specific: line 50
Create 4 distinct improved versions of the SKILL.md, each with a different thesis:
- Very specific: line 62
Follow Aeon skill conventions (read memory, log to memory/logs/${today}.md, notify via ./notify)
- Distinctive: line 79
Write out your scoring with brief justification for each score.
- Very specific: line 89
Write the winning variation to skills/${var}/SKILL.md, replacing the original.
- Very specific: line 93
Create a branch named autoresearch/${var} and commit the change:
- Distinctive: line 139
Never downgrade a working skill.
- Distinctive: line 141
Do not change the skill's tags or var semantics without strong justification.
- Very specific: line 142
Do not add env vars that aren't already available in the workflow (check aeon.yml secrets).
“Common” is measured: kept by at least 6 in 10 of the 87 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
${var} — Name of the skill to evolve (e.g.
token-movers). Required.
If ${var} is empty, abort with: "autoresearch requires var= set to a skill name" and exit.
Read memory/MEMORY.md for context.
Goal
Improve an existing skill by researching better approaches, generating 4 distinct variations, scoring them against a rubric, and committing the winning version as a PR.
Steps
1. Load the target skill
Read skills/${var}/SKILL.md. If the file doesn't exist, abort and notify: "Skill '${var}' not found."
Parse the skill's:
- Purpose: what it does
- Data sources: APIs, URLs, commands it calls
- Output format: what it produces (article, notification, file)
- Dependencies: env vars, tools, other files it reads
Save the original content — you'll need it for the PR diff later.
2. Research improvements
Search the web for better approaches to what this skill does:
- Alternative or complementary APIs/data sources
- Best practices for the skill's domain (e.g., crypto analysis, RSS aggregation, security scanning)
- Common pitfalls or failure modes for the techniques the skill uses
- Output formats that are more actionable or readable
Also review:
- Recent memory/logs/ entries where this skill ran — did it produce useful output? Were there failures?
memory/cron-state.json— has this skill been failing?
3. Generate 4 variations
Create 4 distinct improved versions of the SKILL.md, each with a different thesis:
Variation A — Better inputs: Improve data sources. Add alternative/complementary APIs, better search queries, more reliable endpoints. Fix any broken or deprecated sources found in step 2.
Variation B — Sharper output: Improve the output format and content quality. Make notifications more actionable, articles more substantive, analysis more insightful. Reduce noise, improve signal.
Variation C — More robust: Improve reliability and edge-case handling. Add fallback logic for when APIs fail, better deduplication, graceful handling of empty data, clearer error messages.
Variation D — Rethink: Take a fundamentally different approach to achieving the same goal. Different methodology, different angle, or a creative combination of techniques the original didn't consider.
Each variation must:
- Preserve the original frontmatter format (name, description, var, tags)
- Follow Aeon skill conventions (read memory, log to memory/logs/${today}.md, notify via
./notify) - Be a complete, ready-to-run SKILL.md — no placeholders
- Include a one-line comment at the top of the body:
<!-- autoresearch: variation X — thesis description -->
4. Evaluate and score
Score each variation on a 1-5 scale across these criteria:
| Criterion | What to evaluate |
| Clarity | Will Claude execute this correctly? Are instructions unambiguous? |
| Data quality | Are sources reliable, diverse, and likely to return useful data? |
| Output value | Is the output actionable and worth reading? Low noise? |
| Robustness | Does it handle failures, empty data, and edge cases? |
| Conventions | Does it follow Aeon patterns? (memory, logging, notify, var usage) |
| Improvement | How much better is this than the original? |
Write out your scoring with brief justification for each score. Calculate a weighted total:
- Improvement: 3x weight (the whole point)
- Output value: 2x weight
- Clarity, Data quality, Robustness: 1.5x weight each
- Conventions: 1x weight
5. Select and apply the winner
Pick the highest-scoring variation. If scores are very close (within 2 points total), prefer the variation that makes the biggest single improvement rather than small incremental changes.
Write the winning variation to skills/${var}/SKILL.md, replacing the original.
6. Create a PR
Create a branch named autoresearch/${var} and commit the change:
git checkout -b autoresearch/${var}
git add skills/${var}/SKILL.md
git commit -m "improve(${var}): autoresearch evolution
Variation chosen: [A/B/C/D] — [thesis]
Key changes: [1-2 sentence summary]"
git push -u origin autoresearch/${var}Open a PR with:
- Title:
improve(${var}): autoresearch evolution - Body: Include the full scoring table, the winning variation's thesis, and a diff summary of what changed. Include all 4 variation summaries so the reviewer can see what was considered.
gh pr create --title "improve(${var}): autoresearch evolution" --body "..."7. Notify and log
Send via ./notify:
*Autoresearch — ${var}*
Winner: Variation [X] — [thesis]
Score: [total]/50
Key changes: [summary]
PR: [url]Log to memory/logs/${today}.md:
### autoresearch
- Target: ${var}
- Winner: Variation [X] ([score]/50)
- Thesis: [description]
- PR: [url]
- Runners-up: [brief scores]Network note
There is no network sandbox — curl works, with WebFetch as the fallback for a flaky public GET. For an auth'd API, call ./secretcurl with a {ENV_NAME} placeholder (the key is injected via requires:), never a bare $SECRET.
Constraints
- Never downgrade a working skill. If all variations score lower than or equal to the original on "Improvement", skip the update and notify: "No improvement found for ${var} — all variations scored at baseline."
- Preserve the skill's core purpose — evolution, not replacement.
- Do not change the skill's tags or var semantics without strong justification.
- Do not add env vars that aren't already available in the workflow (check aeon.yml secrets).
Other versions95 projects use a version of this.
Word for word · 3
- aeonfun/aeon★ 782100% same
- aaronjmars/miroshark-aeon★ 18100% same
- MiroShark/miroshark-aeon★ 18100% same
Edited · 0
None found.
Wrote their own version · 92
- github/awesome-copilot★ 41ksame name
- Yeachan-Heo/oh-my-claudecode★ 40ksame name
- Yeachan-Heo/oh-my-claude-sisyphus★ 40ksame name
- Yeachan-Heo/oh-my-codex★ 34ksame name
- AgriciDaniel/claude-obsidian★ 16ksame name
- Orchestra-Research/AI-research-SKILLs★ 13ksame name
- zechenzhangAGI/AI-research-SKILLs★ 13ksame name
- Orchestra-Research/AI-Research-SKILLs★ 12ksame name
- getcompanion-ai/feynman★ 10ksame name
- advaitpaliwal/feynman★ 10ksame name
82 more not listed
How matches are found. Word for word: the exact same text. Edited: shares passages with this file (“99% same” means 99% of its five-word phrases also appear here; 10% or more counts). Their own version: similar meaning, or, weakest, the same name. We can’t tell which project had it first. Projects are counted among the 200 most-starred candidates, and mentions are links to the repository we found, up to 50 per site, so both counts are a floor.
In this repository89 other files it gives its agents.
- AGENTS.mdAGENTS.md
- CLAUDE.mdCLAUDE.md
- llms.txtllms.txt
- aeonSkill
- action-converterSkill
- aeon-doctorSkill
- aeon-updateSkill
- anatomySkill
- arc-studioSkill
- articleSkill
- auto-mergeSkill
- auto-workflowSkill
- base-mcpSkill
- bd-radarSkill
- changelogSkill
- competitor-monitorSkill
- compute-resellSkill
- cortx-reliabilitySkill
- create-proveSkill
- create-skillSkill
- defi-overviewSkill
- deploy-prototypeSkill
- deploy-uni-hookSkill
- digestSkill
- distribute-tokensSkill
- executor-mcpSkill
- featureSkill
- feedback-builderSkill
- fetch-tweetsSkill
- finance-district-mcpSkill
- fleet-controlSkill
- fork-fleetSkill
- github-monitorSkill
- github-trendingSkill
- glim-mcpSkill
- heartbeatSkill
- higgsfieldSkill
- hunter-22Skill
- idea-forgeSkill
- idea-pipelineSkill
- inbox-triageSkill
- install-skillSkill
- investigation-reportSkill
- last30Skill
- memory-flushSkill
- mention-radarSkill
- miroshark-matchdaySkill
- monitor-polymarketSkill
- narrative-convergenceSkill
- narrative-trackerSkill
- onchain-monitorSkill
- operator-scorecardSkill
- pack-submitSkill
- picks-trackerSkill
- pm-manipulationSkill
- posthog-errorsSkill
- price-alertSkill
- pr-reviewSkill
- pr-triageSkill
- remotionSkill
- The first 60 shown.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
Reviews can't be read right now.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

