skill-feedback
Skill6 starsChanged 3 months agoMITView on GitHub
Capture and aggregate real-world usage feedback for Agent Skills so the Skill Quality Gate loop can keep improving them over time. Use it whenever a skill misfires or underperforms: a skill triggered wrongly (wrong trigger), failed to auto-load on a relevant request (near-miss / description gap), produced a wrong, broken, or low-quality output (output issue), or the user manually corrected its result (manual correction). Also use it to review accumulated skill feedback before running skill-forge, or to close the feedback loop that raises skill quality. Writes one structured JSON object per line to feedback/<skill>/YYYY-MM-DD.jsonl and can summarize them into a report/export that feeds skill-forge's Optimize-description step. Trigger phrases: 'skill feedback', 'log skill feedback', 'skill triggered wrongly', 'near-miss trigger', 'wrong trigger', 'output issue', 'manual correction', 'improve skill', 'skill quality', 'feedback loop'.
7 other projects use a version of this.
Adopted by
Most recently taken up by
- adeonir/agent-skillstheir own version, first seen Nov 1, 2026
- ingoclaro/claude-skillstheir own version, first seen Oct 20, 2026
- microsoft/microsoft-sqltheir own version, first seen Oct 13, 2026
- caikiji/skills-labtheir own version, first seen Sep 7, 2026
- Haitam-Elgharras/claude-skill-improvertheir own version, first seen Jul 24, 2026
- bstegemoller/skill-feedbacktheir own version, first seen Jul 10, 2026
Other versions7 projects use a version of this.
Word for word · 0
None found.
Edited · 0
None found.
Wrote their own version · 7
- microsoft/microsoft-sql★ 22same name
- adeonir/agent-skills★ 8same name
- caikiji/skills-lab★ 4same name
- adamkrasny/adams-claude-skills★ 1same name
- Haitam-Elgharras/claude-skill-improver★ 1same name
- bstegemoller/skill-feedback★ 0same name
- ingoclaro/claude-skills★ 0same name
How matches are found. Word for word: the exact same text. Edited: shares passages with this file (“99% same” means 99% of its five-word phrases also appear here; 10% or more counts). Their own version: similar meaning, or, weakest, the same name. We can’t tell which project had it first. Projects are counted among the 200 most-starred candidates, and mentions are links to the repository we found, up to 50 per site, so both counts are a floor.
In this repository59 other files it gives its agents.
- skills/chronos/references/AGENTS.mdAGENTS.md
- api-contract-testingSkill
- api-doc-generatorSkill
- canonSkill
- censorSkill
- changelog-generatorSkill
- chronosSkill
- code-reviewSkill
- commit-lintSkill
- commit-message-writerSkill
- coverage-analyzerSkill
- csv-proSkill
- data-analysisSkill
- deweySkill
- diagram-makerSkill
- doc-compareSkill
- docs-productSkill
- docs-projectSkill
- docs-systemSkill
- dsh-runnerSkill
- frontend-a11ySkill
- frontend-design-tasteSkill
- frontend-perfectionSkill
- frontend-performanceSkill
- frontend-testingSkill
- github-repo-hygieneSkill
- long-running-agent-workflowSkill
- mermaid-to-imageSkill
- mobile-frontendSkill
- pdf-report-builderSkill
- plan-skillSkill
- prd-to-appSkill
- presentation-craftSkill
- presentation-engineeringSkill
- presentation-makerSkill
- raster-to-svgSkill
- reddit-karmaSkill
- repo-community-filesSkill
- repo-metadata-healthSkill
- repo-readme-assetsSkill
- repo-social-previewSkill
- secret-scannerSkill
- security-reviewSkill
- seo-auditSkill
- seo-contentSkill
- seo-crawlSkill
- seo-schemaSkill
- seo-toolkitSkill
- skill-forgeSkill
- skill-suggesterSkill
- sql-helperSkill
- systematic-debuggerSkill
- test-generatorSkill
- test-graphicsSkill
- velesSkill
- version-bumperSkill
- video-script-writerSkill
- web-replicationSkill
- web-scraperSkill
The file
We split this skill into the rules it gives an agent
5 rules. 0 are common, 2 are distinctive, and 3 are very specific to this project.
0
Common
Most of the 6 edited versions we read keep these.
2
Distinctive
This author's own choices. Worth a look.
3
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Very specific: line 117
Before improving a skill, run report to see its accumulated issues.
- Distinctive: line 123
Commit the skill change — and optionally the feedback store — so the loop is reproducible.
- Very specific: line 130
Never put secrets, tokens, or personal data in request / detail.
- Distinctive: line 131
Keep entries factual and short.
- Very specific: line 135
Do not use as a substitute for actually fixing a skill.
“Common” is measured: kept by at least 6 in 10 of the 6 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Skill Feedback — capture the fuel for skill improvement
This skill closes the loop opened by docs/SKILL_QUALITY_GATE.md. The Quality
Gate tells you whether a skill is good; this skill tells you how to make it
better next time by recording what happened in real usage and turning it into
a feed for skill-forge.
Without a feedback capture, improvement is guesswork. With it, every near-miss
trigger and every manual correction becomes a concrete edit to a skill's
description / when_to_use / body.
When to use
- A skill should have triggered but did not (near-miss): the user's request was in-scope but the auto-load missed it.
- A skill triggered wrongly: the wrong skill loaded for the request.
- A skill produced a wrong / broken / low-quality output (output issue).
- The user manually corrected the skill's output (edited the result, or told you "no, do it differently").
- You want to review what has piled up before running
skill-forge.
DO NOT USE FOR
- General chat feedback, venting, or notes unrelated to a specific skill — those belong in memory or the session log, not the skill feedback store.
- Capturing secrets or personal data — never log credentials or PII in entries.
Auto-capture (make it automatic)
For the loop to run without manual nudging, capture feedback proactively.
Append the rule from AGENTS_FRAGMENT.md (repo root) to your opencode
AGENTS.md. Then any near-miss / manual correction is logged automatically —
no explicit "remember this" needed. Each consumer grows their own skills
locally; see docs/SKILL_QUALITY_GATE.md Layer C.
How feedback is stored
Each entry is one JSON object on its own line in:
feedback/<skill-name>/YYYY-MM-DD.jsonlEntry schema:
{
"ts": "2026-08-26T14:03:00",
"skill": "api-contract-testing",
"type": "near_miss_trigger",
"request": "проверь, что эндпоинты совпадают со спецификацией",
"detail": "skill did not auto-load; user had to invoke it manually",
"suggested_fix": "add casual-phrasing trigger 'проверь эндпоинты' to when_to_use",
"source": "user"
}type is one of: near_miss_trigger, wrong_trigger, output_issue,
manual_correction, description_gap.
The script
scripts/feedback.py — pure Python 3 stdlib, no third-party packages. Run it
from this skill folder (e.g. python3 scripts/feedback.py …); the script
resolves the repo root on its own, so the feedback/ store always lands in the
right place regardless of current directory.
| Command | Effect | Exit |
python3 scripts/feedback.py add --skill NAME --type TYPE --request "..." --detail "..." [--fix "..."] | append one entry | 0 on success, 2 on invalid --type |
python3 scripts/feedback.py report [--skill NAME] | aggregate counts by skill+type, list recent near-miss request strings (the exact fuel for trigger optimization) | 0 (prints no feedback recorded when empty) |
python3 scripts/feedback.py export [--skill NAME] | emit a prompt-ready digest for the skill-forge Improve / Optimize-description steps | 0 (prints no feedback to export when empty) |
Verification — capture evidence, not assertion
The loop is not "done" until the script proves the entry landed. After every
add, capture two pieces of evidence:
- The printed line —
addwritesok: appended to <path>on success. That line names the exact file the entry went into, so you can confirm the store grew. - The exit status —
0means the entry was written;2means the--typewas rejected and nothing was saved. Treat any non-zero exit as a failure and fix the command before moving on.
Example evidence capture:
python3 scripts/feedback.py add \
--skill api-contract-testing --type near_miss_trigger \
--request "проверь, что эндпоинты совпадают со спецификацией" \
--detail "skill did not auto-load; user had to invoke it manually" \
--fix "add casual-phrasing trigger 'проверь эндпоинты' to when_to_use"
# expect: ok: appended to feedback/api-contract-testing/2026-08-26.jsonl
# expect: exit 0report and export are read-only and always exit 0; run them before
improving a skill to see the accumulated issues, and paste their output into
the skill-forge session as the basis for trigger/description edits.
How it feeds the loop
- During/after a session, capture near-misses and corrections via
add(or ask the user "should I log this as skill feedback?"). - Before improving a skill, run
reportto see its accumulated issues. - Feed the near-miss
requeststrings intoskill-forge's Optimize description (they become the missing trigger queries); feedmanual_correctionsuggested_fixinto the Improve step. - Re-run the Layer A/B audit (the
docs/skill-quality-audit.mdgenerator) to confirm the edit moved the needle. - Commit the skill change — and optionally the feedback store — so the loop is reproducible.
Privacy & hygiene
- The store lives in the repo under
feedback/. Commit it only if you want the history shared; otherwise gitignore it. - Never put secrets, tokens, or personal data in
request/detail. - Keep entries factual and short; one issue per entry.
Boundaries
- Do not use as a substitute for actually fixing a skill; record evidence, then use
skill-forge.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

