agentleFS
harlan-zwharlan-zw/brundlefly/skills/verify-examples/SKILL.md

verify-examples

Skill7 starsChanged 32 days agoMITView on GitHub

Runs documentation examples, such as commands, code snippets, curl calls, and quickstarts, from their stated setup and checks the promised output. Use whenever someone asks whether the examples in a guide, README, or tutorial still work, without rewriting the whole document.

The file

Show its rules and text

We split this skill into the rules it gives an agent

22 rules. About 0 are common, 22 are distinctive, and 0 are very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈22

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 0

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Check a reader's runnable examples against the documented starting state and promised result.

    line 9
  2. Distinctive:

    Follow the target's instructions, supported version, package manager, and documented checks.

    line 11
  3. Distinctive:

    Read the example, surrounding instructions, prerequisites, and expected result.

    line 15
  4. Distinctive:

    If no example or document location is supplied, ask for it.

    line 16
  5. Distinctive:

    If a core input is missing, report it before dependent execution.

    line 19
  6. Distinctive:

    Read matching source, exports, versioned CLI help, tests, and official documentation where needed.

    line 20
  7. Distinctive:

    Use small private evidence notes for sources, checked revision, expected result, and unresolved questions.

    line 22
  8. Distinctive:

    Keep these evidence notes outside public content and generated downloads.

    line 23
  9. Distinctive:

    Use a clean scratch project or the target's documented fixture where available.

    line 27
  10. Distinctive:

    Run the actual documented setup, commands, and inputs in order.

    line 29
  11. Distinctive:

    Use read-only inspection until state-changing execution is authorized.

    line 30
  12. Distinctive:

    Check consequential conditions and response metadata, rather than only a successful command.

    line 35
  13. Distinctive:

    Check documented cleanup and recovery for observed failures.

    line 37
  14. Distinctive:

    If repair is authorized, fix the smallest underlying mismatch in the example and dependent explanation.

    line 46
  15. Distinctive:

    If only a review was requested, return the repair proposal without editing files.

    line 47
  16. Distinctive:

    Keep the original example and observed failure in private evidence.

    line 48
  17. Distinctive:

    After editorial edits change a verified command or claim, repeat its affected checks.

    line 50
  18. Distinctive:

    Do not reuse an earlier revision's result to claim the final example works.

    line 51
  19. Distinctive:

    If execution is unavailable, inspect the best available evidence and name the untested path.

    line 53
  20. Distinctive:

    Do not fabricate output, silently substitute a different interface, or hide a failed check.

    line 54
  21. Distinctive:

    Keep the verification thorough even when the report is brief.

    line 61
  22. Distinctive:

    Keep detailed transcripts outside the public document.

    line 65

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Verify examples

Check a reader's runnable examples against the documented starting state and promised result. This pass owns example verification and requested repairs. It does not write or review the whole guide. Follow the target's instructions, supported version, package manager, and documented checks.

Establish the example contract

Read the example, surrounding instructions, prerequisites, and expected result. If no example or document location is supplied, ask for it. Do not search for a replacement task. Identify the runtime, package version, working directory, configuration, inputs, and required access. Separate runnable code from pseudocode, schematic output, and illustrative fixtures. If a core input is missing, report it before dependent execution. Read matching source, exports, versioned CLI help, tests, and official documentation where needed. Reconcile checkout behavior with the release the reader can install. Use small private evidence notes for sources, checked revision, expected result, and unresolved questions. Keep these evidence notes outside public content and generated downloads.

Run the reader's path

Use a clean scratch project or the target's documented fixture where available. Match the stated starting state. Do not rely on prior session setup. Run the actual documented setup, commands, and inputs in order. Use read-only inspection until state-changing execution is authorized. Writing documentation does not authorize production writes, spending, installation, or sending messages. For authorized changes, use an isolated environment where possible. Keep credentials out of code and captured output.

Observe exit status, output, and relevant side effects. Compare them with the promised result. Check consequential conditions and response metadata, rather than only a successful command. For a protocol example, inspect applicable status, headers, body, and conditions against its official specification. Check documented cleanup and recovery for observed failures. Derive checks from the requested scope and supporting evidence. Do not invent a broad edge-case suite. Source inspection, lint, and builds cannot substitute for execution of the example. A successful common path does not establish every supported platform or condition.

Repair and repeat

For each failure, record expected behavior, actual observation, evidence, and the affected passage. Distinguish a wrong instruction from unavailable access, tooling, or environment. If repair is authorized, fix the smallest underlying mismatch in the example and dependent explanation. If only a review was requested, return the repair proposal without editing files. Keep the original example and observed failure in private evidence. Repeat the failed check and any checks affected by the repair. After editorial edits change a verified command or claim, repeat its affected checks. Do not reuse an earlier revision's result to claim the final example works.

If execution is unavailable, inspect the best available evidence and name the untested path. Do not fabricate output, silently substitute a different interface, or hide a failed check. Report only actions actually performed. A tool with no result supplies no inspection evidence. Mark illustrative output as illustrative. Keep an unsupported core reader path identified as a draft.

Return the evidence

Predict attention for the handoff. Lead with failed reader paths and consequential limits; summarize routine successful checks. Keep the verification thorough even when the report is brief.

State the version or revision, path that ran, observed outcome, and remaining limits. Distinguish executed examples from examples checked only against source. Keep detailed transcripts outside the public document. Report meaningful repairs when requested. Verification does not grant permission to publish or deploy the result.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.