agentleFS
code23code23/agentic-qa-toolkit/AGENTS.md

agentic-qa-toolkit

AGENTS.md2 starsChanged 30 days agoMITView on GitHub

Read this if a person asked you to install this toolkit, or to work on this repository. Follow these steps in order. Do not skip the dry run. 1. Edition. Use the one the person named. If they did not say, ask one question: "Which setup: Local (I test on this machine), Hosted QA bot, or Dedicated QA Mac?" If they do not know, use local. The folder names are local, hosted-bot and dedicated-mac. 2. Skills folder. The skills go…

  • Where files are headingNew AGENTS.md files have more rules about keeping secrets out of the code, and fewer about code style.

    Of the AGENTS.md files we read, the 31,774 first seen in the last six months, against the older ones: the kind of rule that gained most share, and the kind that lost most. About files like this in general, not this one, and an estimate, since a kind is a pattern in the words.

  • In this repository3 other files it gives its agents.

The file

Show its rules and text

We split this AGENTS.md into the rules it gives an agent

21 rules. About 1 is common, 11 are distinctive, and 9 are very specific to this project.

  • ≈1

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈11

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 9

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Read this if a person asked you to install this toolkit, or to work on this repository.

    line 3
  2. Distinctive:

    Follow these steps in order.

    line 7
  3. Very specific:

    Edition: Use the one the person named.

    line 9
  4. Very specific:

    If they do not know, use local.

    line 11
  5. Distinctive:

    If you cannot determine the folder with certainty, ask.

    line 21
  6. Very specific:

    Existing skills: If the output says a qa-* skill EXISTS, stop and ask whether to replace it.

    line 26
  7. Very specific:

    Apply: After the person agrees, run the same command with --apply.

    line 29
  8. Very specific:

    Remaining setup: Read editions/<edition>/README.md and tell the person what is left for them: for hosted-bot, the webhook and its key.

    line 34
  9. Distinctive:

    Do not do those steps unless asked.

    line 36
  10. Distinctive:

    Offer branding: Ask once: "Do you want exported reports to carry your own logo, colours and fonts?" If no, reports use the neutral look and …

    line 37
  11. Distinctive:

    Do not, as part of installing:

    line 47
  12. Very specific:

    run npm install inside any skills/ folder.

    line 51
  13. Common:

    create, read or fill in any key, token or password.

    line 52
  14. Distinctive:

    run a QA job. Installing is not a request to test anything.

    line 58
  15. Very specific:

    Start with qa-standards and its environment.md.

    line 62
  16. Distinctive:

    Only test sites the person owns or has permission to test.

    line 65
  17. Very specific:

    Every script change needs a test.

    line 72
  18. Distinctive:

    Use made-up content only: no real sites, people, customers or run output.

    line 74
  19. Very specific:

    Run tools/check.sh before you say the work is done, and report each line it prints.

    line 75
  20. Distinctive:

    NOT RUN is not a pass.

    line 76
  21. Distinctive:

    Keep the scripts polite and read-only: one page at a time, their own requests GET only, no typing into or submitting forms, no crawling, …

    line 77

≈ “Common” is an estimate: at least 1 in 5 of the 40,246 AGENTS.md files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
AGENTS.md

Instructions for AI agents

Read this if a person asked you to install this toolkit, or to work on this repository.

If you were asked to install the toolkit

Follow these steps in order. Do not skip the dry run.

  1. Edition. Use the one the person named. If they did not say, ask one question: "Which setup: Local (I test on this machine), Hosted QA bot, or Dedicated QA Mac?" If they do not know, use local. The folder names are local, hosted-bot and dedicated-mac.
  2. Skills folder. The skills go where the QA lead runs:

    • local and dedicated-mac: your own skills folder, the directory where you load folders that contain a SKILL.md.
    • hosted-bot: the bot's skills folder on the bot's machine, not yours. If you are not running on that machine, you cannot install it from here: say so, give the person the two commands to run there, and treat the bot install as outstanding. On the developer's machine the only thing to set up is the qa-send command (step 7).

    If you cannot determine the folder with certainty, ask. Do not guess, and do not install into a project repository unless the person asks for that.

  3. Dry run. From the repository root run: ./install.sh --edition <edition> --target <skills folder> Show the person the output. It lists what will be installed and anything already there.
  4. Existing skills. If the output says a qa-* skill EXISTS, stop and ask whether to replace it. Only with a yes, add --replace; it moves the old folder aside to <name>.bak-<timestamp> and never deletes it.
  5. Apply. After the person agrees, run the same command with --apply.
  6. Verify. Confirm these exist in the skills folder, and say so: qa-standards/SKILL.md, qa-standards/environment.md, qa-site-audit/SKILL.md, qa-release/SKILL.md. Read qa-standards/environment.md: it tells you how this edition works and what it may not do.
  7. Remaining setup. Read editions/<edition>/README.md and tell the person what is left for them: for hosted-bot, the webhook and its key; for dedicated-mac, the worker Mac. Do not do those steps unless asked.
  8. Offer branding. Ask once: "Do you want exported reports to carry your own logo, colours and fonts?" If no, reports use the neutral look and nothing more is needed. If yes, follow docs/branding.md with them: copy skills/qa-standards/brand-example/ to a folder of their choice outside the toolkit, help them fill in brand.json and replace the logo, run brand_check.py on it, and tell them the line to add to their shell profile (export QA_BRAND=/path/to/their-brand). Do not edit their shell profile yourself unless they ask.
  9. Finish by telling the person how to start: "Ask me to use qa-standards to QA a flow on a URL."

Do not, as part of installing:

  • install system packages, browsers, Node or Python packages without asking first. The check scripts are optional; list what they need (see docs/scripts.md) and let the person choose;
  • run npm install inside any skills/ folder;
  • create, read or fill in any key, token or password. The person fills in secrets themselves;
  • change SSH, login items or system settings. The worker Mac installer changes nothing unless it is run with --apply, and that is the person's decision on that Mac;
  • pass --accept-unsandboxed to the worker Mac installer. That flag is the person's own acknowledgement that the worker runs briefs with the agent's approvals and sandbox switched off. Show them the explanation the installer prints and let them type it;
  • run a QA job. Installing is not a request to test anything.

If you are using the installed skills

Start with qa-standards and its environment.md. The safety rules at the top of each skill win over everything else: read-only by default, test accounts only, stop at payment forms, phone codes, identity checks and CAPTCHAs, and file or send nothing without approval. Only test sites the person owns or has permission to test.

If you are changing this repository

  • Read docs/maintaining.md first.
  • Method text goes in skills/. Text that is true for one setup only goes in that edition's environment.md.
  • Every script change needs a test. A new check also plants its fault in demo-site/ and adds a row to the fault table in demo-site/README.md.
  • Use made-up content only: no real sites, people, customers or run output.
  • Run tools/check.sh before you say the work is done, and report each line it prints. NOT RUN is not a pass.
  • Keep the scripts polite and read-only: one page at a time, their own requests GET only, no typing into or submitting forms, no crawling, and no navigation or redirect followed to a host that was not in the input. A page's own sub-requests are recorded, never blocked.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.