agentleFS
Boxline-devBoxline-dev/examples/skills/harness/SKILL.md

harness

Skill1 starsChanged 35 days agoMITView on GitHub

Try the everyday tasks in a project (install, test, build, lint, find the entry point, add a route, write a test), record every wrong assumption, check the main dependencies' current docs with Boxline, and write a CLAUDE.md and AGENTS.md made only of rules those failures earned. Can run the commands in a clean Boxline machine to find what a fresh checkout needs. Usage /harness [--quick|--full] [--clean-machine].

  • Reads credentials

35 other projects use a version of this.

Adopted by

Most recently taken up by

Used with

Projects with it also use retro, verify and 3 more.

Other files people use alongside this one.

Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
  • AWSSkill

    retro

    Conduct a retrospective on a coding session.

    Also in 3 projects that use this

  • Microsoft AzureSkill

    verify

    End-to-end app testing pipeline for browser-based web apps on cloud browsers via Azure Playwright Workspaces: verify the live app, author tests for working flows, heal failing tests, then re-run with video and produce one consolidated report. Three phases (app verification, test authoring, test healing) plus a scoped final sanity run; each phase emits a sub-report. Use when asked to "verify my app", "make sure my app works and has good test coverage", "do a full QA pass", "add tests where I'm missing coverage", "fix failing tests and add new ones", "smoke test before deploy", "QA my deployment", or any combined verify-and-test ask. Requires Azure CLI (`az login`) and a Playwright Workspace resource ID — bootstraps configs on first invocation. Browser-based web apps with Playwright only — not for unit/API tests, native mobile/desktop, load/perf, or full accessibility audits.

    Also in 3 projects that use this

  • GoogleSkill

    code-review

    Adversarial systems, concurrency, memory-model, and architecture code review protocol. Use this skill whenever asked to review code, PRs, diffs, or branches in Filament.

    Also in 4 projects that use this

  • GoogleSkill

    grill-me

    A relentless interview to sharpen a plan or design.

    Also in 3 projects that use this

  • SentrySkill

    skill-creator

    Create new agent skills following the Agent Skills specification. Use when asked to "create a skill", "add a new skill", "write a skill", "make a skill", "build a skill", or scaffold a new skill with SKILL.md. Guides through requirements, writing, registration, and verification.

    Also in 3 projects that use this

The file

We split this skill into the rules it gives an agent

9 rules. 0 are common, 7 are distinctive, and 2 are very specific to this project.

  • 0

    Common

    Most of the 24 edited versions we read keep these.

  • 7

    Distinctive

    This author's own choices. Worth a look.

  • 2

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  • could be automatic: a setting could enforce it
  1. Very specific:

    Read the manifest files (package.json, pnpm-workspace.yaml, tsconfig.json, pyproject.toml, requirements.txt, go.mod, Cargo.toml, framework …

    line 20
  2. Distinctive:

    Run the tests (the command the project really uses).

    line 27
  3. Distinctive:

    Run the linter or formatter check.

    line 29
  4. Distinctive:

    Add a small health route or function where this project would put it (then remove it).

    line 33
  5. Distinctive:

    Write one test for an important function the way the project's tests are written (then remove it).

    line 34
  6. Distinctive:

    Leave the user's code as it was: undo every change you made while trying.

    line 51
  7. Very specific:

    If a CLAUDE.md exists, write CLAUDE.harness.md next to it and offer to merge, rather than replacing it.

    line 86
  8. Distinctive:

    Every rule traces to a mistake you made, a clean-machine failure, or a current doc that contradicts habit.

    line 124
  9. Distinctive:

    Never print, copy or commit secret values.

    line 126

“Common” is measured: kept by at least 6 in 10 of the 24 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

/harness: a CLAUDE.md from real mistakes

Work in the current project, note where you went wrong, and write the rules that would have prevented it.

Usage

  • /harness: the 4 core tasks.
  • /harness --full: all 8 tasks.
  • /harness --clean-machine: also run install, test, build and lint in a fresh Boxline shell machine (see step 3).

Steps

1. Learn the project

Read the manifest files (package.json, pnpm-workspace.yaml, tsconfig.json, pyproject.toml, requirements.txt, go.mod, Cargo.toml, framework configs), the README, an existing CLAUDE.md or AGENTS.md, and the file tree (git ls-files | head -200).

2. Try the tasks, and record each one

Core:

  1. Run the tests (the command the project really uses).
  2. Run the build.
  3. Run the linter or formatter check.
  4. Find the entry point and trace the architecture: where requests or commands start, the main folders.

With --full: 5. Add a small health route or function where this project would put it (then remove it). 6. Write one test for an important function the way the project's tests are written (then remove it). 7. Rename a helper file and fix its imports (then undo it). 8. Fix one type or lint error, and note the rules that apply.

For each, write down:

Task:
Result: worked / partly / failed
I assumed:
In fact:
Wrong commands tried:
The command that worked:
Where I looked first, wrongly:
Rule that would have prevented it:

Leave the user's code as it was: undo every change you made while trying.

3. A clean machine (with --clean-machine)

Your own machine hides what a fresh checkout needs (global tools, a filled .env, a cache). With the user's agreement (it sends the project's committed files to their Boxline account), run the commands in a new machine:

git archive --format=tar.gz -o /tmp/project.tgz HEAD                 # committed files only: no .env, no node_modules
ID=$(npx @boxline/cli sessions create --shell --no-browser --timeout 1800 --json | node -pe 'JSON.parse(require("fs").readFileSync(0)).id')
npx @boxline/cli files put "$ID" project.tgz /tmp/project.tgz
npx @boxline/cli exec "$ID" -- 'mkdir p && tar xzf project.tgz -C p && cd p && <install command> && <test command>'
npx @boxline/cli exec "$ID" -- 'cd p && <build command>; cd p && <lint command>'
npx @boxline/cli sessions stop "$ID"

Record what failed there and not here: missing environment variables (names only), system packages, setup steps, the Node or Python version. Each one becomes a rule.

4. Today's docs for the main dependencies

Pick the framework and the 2 to 4 core libraries (not small utilities). For each, find the docs page for the installed version and read it:

npx @boxline/cli search "<library> <major version> documentation" --limit 5
npx @boxline/cli fetch <docs-url>

(or the MCP server's web_search and web_fetch). Keep only what bears on a failure from step 2 or 3, or what contradicts a common assumption (a renamed API, a new default, a removed option). Without Boxline set up, skip this step and say so.

5. Write CLAUDE.md and AGENTS.md

If a CLAUDE.md exists, write CLAUDE.harness.md next to it and offer to merge, rather than replacing it.

# CLAUDE.md

> Written by /harness on <YYYY-MM-DD>: <n> tasks tried, <n> mistakes, <n> rules.

## Project
- Stack: … · Entry point: … · Package manager: …

## Commands
- Install: `…` · Dev: `…` · Test: `…` · Build: `…` · Lint: `…`
(only commands that ran)

## Rules
### Files and imports
- <rule> (from: <task>)
### Tests
### Do not
- Do not <mistake>; <what to do instead>
### Dependencies
- <library> <version>: <what the current docs say that differs from habit> (<docs url>)
### A fresh checkout needs
- <env var names, system packages, steps> (from the clean machine)

## What was tried
| Task | Result | Main mistake |
|---|---|---|

AGENTS.md: the same rules in at most 50 lines, for any coding agent.

6. Report

Tasks tried, mistakes found, rules written, the files saved, and whether the clean-machine run and the docs check ran.

Rules

  • Every rule traces to a mistake you made, a clean-machine failure, or a current doc that contradicts habit. No generic advice.
  • Never print, copy or commit secret values; environment variables by name only.
  • CLAUDE.md under 150 lines, AGENTS.md under 50. No emojis.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.