QACraft
AGENTS.md2 starsChanged 3 months agoMITView on GitHub
QACraft contains 25 versioned QA workflow skills, safe project installation adapters, and deterministic behavior evaluations. Skill documents describe controlled behavior but do not replace runtime permission enforcement. When the user invokes /name or asks for work matching a canonical skill: Do not manually copy QACraft skills when the supported CLI can be used. Preview and apply through: Add --apply only after reviewing the plan. The same explicit adapter and destination must be used for verify-install, update, and uninstall. Never add…
We split this AGENTS.md into the rules it gives an agent
17 rules. About 0 are common, 14 are distinctive, and 3 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈14
Distinctive · estimate
This author's own choices. Worth a look.
3
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Very specific: line 9
When the user invokes /name or asks for work matching a canonical skill:
- Distinctive: line 12
Read the selected skill completely.
- Distinctive: line 13
Read the shared policies referenced by this repository:
- Distinctive: line 23
Default to drafting and read-only analysis.
- Distinctive: line 26
Never invent evidence, execution, approvals, or source content.
- Distinctive: line 28
Keep manual overrides separate from calculated QA outcomes.
- Very specific: line 32
Do not manually copy QACraft skills when the supported CLI can be used.
- Very specific: line 42
Add --apply only after reviewing the plan.
- Distinctive: line 44
Never add force-overwrite, force-delete, user-global path guessing, automatic agent detection, or configuration-file modification without a …
- Distinctive: line 48
Use deterministic evaluation only for supplied structured candidate reports:
- Distinctive: line 66
When editing a skill:
- Distinctive: line 69
update shared policies or schemas when a rule applies across skills.
- Distinctive: line 73
When editing adapters, lifecycle code, schemas, rubrics, evaluation logic, or release metadata:
- Distinctive: line 76
add focused regression tests.
- Distinctive: line 77
update compatibility and safety documentation.
- Distinctive: line 78
keep canonical skill sources unchanged unless the catalog or generator intentionally changes them.
- Distinctive: line 80
Run before proposing a release:
≈ “Common” is an estimate: at least 1 in 5 of the 36,368 AGENTS.md files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Agent Instructions
Repository purpose
QACraft contains 25 versioned QA workflow skills, safe project installation adapters, and deterministic behavior evaluations. Skill documents describe controlled behavior but do not replace runtime permission enforcement.
Command resolution inside this repository
When the user invokes /name or asks for work matching a canonical skill:
- Locate
skills/name/SKILL.md. - Read the selected skill completely.
- Read the shared policies referenced by this repository:
shared/qa-standards.mdshared/security-boundaries.mdshared/approval-policy.mdshared/evidence-policy.mdshared/data-safety.mdshared/result-model.mdshared/publication-policy.mdshared/release-policy.mdwhen a release outcome is involved.
- Resolve tool and connector capabilities before claiming an action is enforceable.
- Default to drafting and read-only analysis.
- Require the documented gate before any external write, destructive action, production access, customer-data access, or publication.
- Preserve invalid, blocked, error, aborted, cancelled, inconclusive, and not-tested states.
- Never invent evidence, execution, approvals, or source content.
- Validate structured output against repository schemas where applicable.
- Keep manual overrides separate from calculated QA outcomes.
Project installation
Do not manually copy QACraft skills when the supported CLI can be used.
Preview and apply through:
python3 scripts/qacraft.py install <skill> \
--agent <codex|claude-code|generic> \
--destination /explicit/project/rootAdd --apply only after reviewing the plan. The same explicit adapter and destination must be used for verify-install, update, and uninstall.
Never add force-overwrite, force-delete, user-global path guessing, automatic agent detection, or configuration-file modification without a separately reviewed design and safety model.
Behavior evaluation
Use deterministic evaluation only for supplied structured candidate reports:
python3 scripts/qacraft.py evaluate --input candidate.jsonThe evaluator does not prove evidence authenticity or runtime permission enforcement. Do not convert a failed check into a pass through narrative interpretation.
Priority rubrics currently exist for:
feature-qaticket-reviewbug-reportverify-fixrelease-qa
Repository changes
When editing a skill:
- change
catalog/skills.jsonor the generator rather than hand-editing generated files; - update shared policies or schemas when a rule applies across skills;
- regenerate documentation;
- review every generated diff.
When editing adapters, lifecycle code, schemas, rubrics, evaluation logic, or release metadata:
- preserve preview-first behavior and containment checks;
- add focused regression tests;
- update compatibility and safety documentation;
- keep canonical skill sources unchanged unless the catalog or generator intentionally changes them.
Run before proposing a release:
python3 scripts/generate_docs.py
python3 scripts/validate_repo.py
python3 -m unittest discover -s tests -v
python3 scripts/qacraft.py release-check
python3 scripts/demo.pyComplete branch edits before opening a pull request when practical. The repository intentionally uses one Python 3.12 validation job per PR and no automatic post-merge workflow.
Where files are headingNew AGENTS.md files have more rules about keeping secrets out of the code, and fewer about code style.
Of the AGENTS.md files we read, the 28,693 first seen in the last six months, against the older ones: the kind of rule that gained most share, and the kind that lost most. About files like this in general, not this one, and an estimate, since a kind is a pattern in the words.
In this repository26 other files it gives its agents.
- CLAUDE.mdCLAUDE.md
- api-qaSkill
- automation-reviewSkill
- bug-reportSkill
- bug-triageSkill
- customer-issue-reproSkill
- exploratory-qaSkill
- feature-qaSkill
- flaky-test-triageSkill
- incident-qaSkill
- network-qaSkill
- offline-qaSkill
- permission-qaSkill
- platform-matrixSkill
- playback-qaSkill
- qa-daily-summarySkill
- qa-handoffSkill
- qa-retrospectiveSkill
- regression-scopeSkill
- release-qaSkill
- smoke-testSkill
- staged-rollout-checkSkill
- test-case-reviewSkill
- test-planSkill
- ticket-reviewSkill
- verify-fixSkill
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

