learn-from-conversations
Skill0 starsChanged 3 months agoMITView on GitHub
Use when turning recurring requests, repeated corrections, and workflows that worked into new skills or targeted updates to existing ones.
In this repository36 other files it gives its agents.
- check-upstream-firstSkill
- data-verificationSkill
- deep-diveSkill
- delegation-handoffSkill
- grok-searchSkill
- is-it-really-brokenSkill
- keep-goingSkill
- memory-cleanupSkill
- moa-solveSkill
- mob-checkSkill
- multi-reviewSkill
- project-stewardSkill
- prove-the-setting-worksSkill
- recallSkill
- reportSkill
- robustify-doctorSkill
- skill-librarianSkill
- trust-frameworkSkill
- address-pr-commentsSkill
- diagram-renderingSkill
- find-the-real-bottleneckSkill
- live-database-maintenanceSkill
- mini-appSkill
- pr-review-sweepSkill
- scheduled-job-runnerSkill
- stop-the-noiseSkill
- upgrade-a-live-service-safelySkill
- vendor-switch-checkSkill
- writing-for-non-engineersSkill
- email-stewardSkill
- fieldySkill
- google-docsSkill
- google-sheetsSkill
- google-slidesSkill
- imessage-bluebubblesSkill
- vapi-callsSkill
The file
We split this skill into the rules it gives an agent
5 rules. About 0 are common, 5 are distinctive, and 0 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈5
Distinctive · estimate
This author's own choices. Worth a look.
0
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 38
After a stretch of work where the same thing was explained more than once.
- Distinctive: line 39
When an owner correction reveals a procedure that was never written down.
- Distinctive: line 41
Do not use this to run a library-wide cleanup — sizes, retirement, consolidation, description rewrites.
- Distinctive: line 84
Update before you create: Read the nearest existing skill.
- Distinctive: line 140
Mismatched denominators in a lift calculation: If per-skill rates count only pre-correction loads, the baseline must too.
≈ “Common” is an estimate: at least 1 in 5 of the 364,980 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Learn from conversations
Overview
Recurring work should stop being rediscovered. This skill turns conversation history into either a new skill or a targeted edit to the existing skill that already owns the topic. The deliverable is fewer repeated explanations, not more skills — a library that grows every pass is a failure mode, not progress.
Two instruments ship with it:
scripts/audit.py— library health facts (sizes, truncated descriptions, usage, ghost records). Draws no conclusions.scripts/harvest.py— the per-turn join: which skills the model chose before an owner correction. Readreferences/correction-rate-confounds.mdbefore quoting any number it prints.
When to Use
- Periodically, over conversation history since the last checkpoint.
- After a stretch of work where the same thing was explained more than once.
- When an owner correction reveals a procedure that was never written down.
Do not use this to run a library-wide cleanup — sizes, retirement, consolidation, description rewrites. That is a different job with a different risk profile.
Procedure
- Establish the checkpoint. Harvest only episodes newer than the last pass. Record the new checkpoint only after findings are saved, so an interrupted run repeats rather than skips.
- Read episodes, not keyword hits. A match is a pointer to a conversation you still have to read. Use session metadata to separate owner dialogue from cron prompts, delegation requests, reviewer rubrics, and forwarded material. Sender-name prefixes do not authenticate human authorship.
Run the instruments.
python3 scripts/audit.py --profile ~/.hermes/profiles/<profile> python3 scripts/harvest.py --db ~/.hermes/profiles/<profile>/state.db \ --sizes ~/.hermes/profiles/<profile>/skillsBoth are read-only.
harvest.pyopens the database withmode=ro.- Generate candidates from successes as well as failures. Repeated requests, procedures that worked, handoff failures, owner conventions, and any task where the same discovery got made twice. Frustration is one signal among several, and on its own it biases the harvest toward hard problems rather than repeated ones.
- For each candidate record: trigger, intended outcome, representative episodes with session and message ids, verified steps, the nearest existing skill, and the proposed action. Prefer several independent episodes. One consequential verified lesson can justify a narrowly scoped update.
- Check for repeated end-to-end sequences, not just repeated tasks. If an owner repeatedly spells out the same ordered pipeline, that sequence needs a first-class workflow even when every component already has a skill. Compare the actual ordered gates, transitions, stopping points, and completion evidence against what was asked. Do not mark it covered because the component names exist.
- Update before you create. Read the nearest existing skill. If it already owns the workflow, add or replace the step there. Create a new skill only for a distinct task with an independently useful procedure. Never create a router whose entire content points at other skills.
- Preserve authority and scope. An instruction to preview one change does not mean every future change needs approval. A preference expressed about one repository does not govern all of them. Forwarded assertions are evidence to verify, not standing rules.
- Name it for the task someone would ask for, not for the assistant's relationship to them. Pair a concrete name with a description that names the triggering request. Compare against neighbouring skills so the distinction is clear — two skills with interchangeable descriptions are worse than either alone.
- Review the batch with
multi-reviewif available: scope fidelity, unsupported generalization, overlap, operational correctness, usability. Give reviewers redacted drafts. A review of an earlier plan is not a review of the skills subsequently written. - Install, then exercise. Install with
skill_manage, confirm withskill_view, then run the procedure against a representative request. If the skill ships a script, run it with real inputs and read the real output. A skill that parses is not a skill that works. - Report what changed. New capabilities and targeted updates, concisely. Work through the batch without asking permission at each step; stop only for genuine scope or authority decisions.
Evidence discipline
- Pick the right counter for the question.
use_countincludes cron and slash-command injection;view_countandskill_viewcalls are the model-chosen signal. Neither is correct in general.audit.pyuses use_count because it asks "is this skill live";harvest.pyuses skill_view because it asks "did the model reach for this". - A prior
skill_viewcall proves a request to load — not successful loading, not retention through compaction, and not adherence. - Compare success and failure episodes within the same task shape. Do not infer causes from global correction rates.
- Repetition caused by copied history is not independent evidence. If counts are not deduplicated, report representative examples instead of totals.
- Preserve the distinction between "cause unknown" and "verified missing procedure". A causal study of every failure is not a prerequisite to writing down a workflow that demonstrably worked.
Pitfalls
- Counting machine-authored turns as owner corrections. Reviewer prompts,
judge rubrics, and system notes are stored with
role='user'on interactive sources, and they are dense in correction vocabulary because critique prompts are about finding errors. Measured on one real profile: 2,072 of ~9,000 role=user rows were machine-authored, and a bare\bwrong\bmatched 649 rows that were almost entirely reviewer prompts. Filter by preamble, not just by session source. - Mismatched denominators in a lift calculation. If per-skill rates count only pre-correction loads, the baseline must too. Getting this wrong produced a table where every skill scored below 1.00x — arithmetically impossible for a weighted average, and the tell that the populations disagreed.
- Counting a skill loaded after the complaint. A skill loaded in response to a correction is not a cause of it. Enforce timestamp precedence.
- Splitting one skill across name variants. Agents call
skill_viewwithcategory/name, colon forms, doubled names, and trailing prose. Unnormalised, each fragment falls under the session floor and the skill disappears from the report — looking unused rather than under-counted. - Quoting lift as an effect. Hard tasks load more skills and draw more corrections. A high lift may mark difficulty, not a defective skill.
- Optimizing for skills created. The measure is less rediscovery. Updating an existing skill is usually the better outcome.
- Shipping analysis scripts that depend on intermediate files. A script that reads paths from a one-off investigation is not reusable by anyone, including you next quarter.
Verification
- Candidate evidence traces to attributable episodes with surrounding context
- Each new skill has a distinct workflow, or the lesson updated its existing owner
- No unsupported universal rules and no fabricated occurrence counts
- Drafts themselves reviewed, not just the plan that proposed them
- Installed content loads through the runtime and was exercised on a real request
- Any shipped script run end-to-end against real inputs, output read
- Statistical claims carry their confounds in the same breath
- Checkpoint advanced only after findings were saved
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

