agentleFS
selamy-labsselamy-labs/agent-skills/skills/test-design/SKILL.md

test-design

Skill0 starsChanged 5 days agoMITView on GitHub

Use when writing or reviewing tests: how to STRUCTURE and NAME them, what one test should cover, and when to split versus parameterize versus use soft assertions. Covers test structure and design, not the red-green-refactor workflow.

18 other projects use a version of this.

Adopted by

Most recently taken up by

Used with

Projects with it also use diff-review.

Other files people use alongside this one.

Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
  • MidnightDarlingSkill

    diff-review

    使用场景:按 raw.review.md 清单改完稿后,对 raw.md(OCR 原始)和 final.md(定稿)做对比。说"看我改了哪些""对比一下""diff""校对完了让我看看""我到底接受了哪些建议""我漏改了啥""改动统计""核对一下改动""闭环检查"都走这个 skill。生成段落级 HTML diff,关联 raw.review.md 的 A/B/C 标注,一目了然:接受了哪些 agent 建议、拒绝了哪些、清单外修正了哪些、agent 标过但漏改了哪些。主动触发,不必等用户说 "diff-review"。

    Also in 3 projects that use this

The file

We split this skill into the rules it gives an agent

4 rules. 0 are common, 2 are distinctive, and 2 are very specific to this project.

  • 0

    Common

    Most of the 12 edited versions we read keep these.

  • 2

    Distinctive

    This author's own choices. Worth a look.

  • 2

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Very specific:

    Every test visibly separates Arrange → Act → Assert (Given/When/Then), by blank line or comment.

    line 13
  2. Very specific:

    Use soft assertions (assertSoftly / assertAll / expect.soft) to check several properties of one result and report all failures at once — …

    line 18
  3. Distinctive:

    Use separate test methods for DIFFERENT behaviors — don't cram two rules into one parameterized table.

    line 35
  4. Distinctive:

    Test replay after a lost response both while the original operation is pending and after its effect has committed or completed.

    line 48

“Common” is measured: kept by at least 6 in 10 of the 12 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Test Design

How to design tests that localize failures and read like a spec. This complements — does not duplicate — the upstream TDD-workflow skills (red→green→refactor) and pairs with the code-style foundation: those cover when/how you drive code with tests; this covers what a good test looks like.

Principles are language-agnostic; per-language bindings are at the end.

1. Visible AAA / Given-When-Then

Every test visibly separates Arrange → Act → Assert (Given/When/Then), by blank line or comment. The three phases should be findable at a glance. A test where setup, action, and verification are tangled is a test you can't read at failure time.

2. One concept per test (NOT literally one assertion)

Each test verifies ONE behavior, so a failure localizes precisely and the test name describes exactly one thing.

  • This usually means one or a few assertions — but multiple physical assertions are correct when they jointly verify ONE concept (e.g. asserting every field of one returned object = "constructed correctly" = one concept).
  • Use soft assertions (assertSoftly / assertAll / expect.soft) to check several properties of one result and report all failures at once — strictly better than splitting into N tests that each re-run the same arrange/act.
  • Split into separate tests only when the BEHAVIORS differ, never when the PROPERTIES of one result differ.
  • Honest framing: "single concept, not literally single assert." Do not ship one-assert-per-test dogma.

3. Small, focused cases with descriptive, sentence-like names

The name is the spec. returns_404_when_run_id_is_unknown, not test3. A reader should know what broke from the failed test's name alone, without opening the body.

For a workflow or transition test, invoke the production entrypoint and its real collaborators through the boundary named by the test. Keep relevant adapters, parsers and predicates composed; fake external effects at their boundary (see [[prefer-fakes-over-mocks]]). Separate helper tests, source-text order checks and fixtures never passed to the entrypoint do not prove that composition. Choose inputs that expose a broken hand-off, and keep each test's name and conclusion within the boundary it actually exercises.

4. Parameterize data variation; separate methods for different behaviors

  • Parameterize (table-driven) across DATA variation of ONE behavior — many inputs, same rule. Give each case a descriptive label so a failure names the offending case.
  • Use separate test methods for DIFFERENT behaviors — don't cram two rules into one parameterized table.

5. DAMP over DRY

Optimize tests for readability-at-failure, not DRY elegance. Inline repetition in tests is fine and often better. DAMP ≠ no helpers — do use test-data builders/factories where they aid clarity — just never hide the AAA behind abstraction layers. A test you must trace through three helpers to understand is a bad test even if it's DRY.

6. Comments: name + structure carry the WHAT; comment the WHY

The test name and AAA structure tell the story. Reserve comments for the WHY — business-rule rationale, non-obvious edge cases — not a play-by-play of the WHAT. Density is language-dependent: expressive languages (e.g. Kotlin) need very few; if the code reads like English, comment only business logic / non-obvious implementation. Don't go heavy.

7. Honest cost

Single-concept tests multiply the test count → more suite time + maintenance. State the tradeoff; don't pretend it's free. Mitigate with: parameterization (one method, many cases), cheap arrange (builders, fixtures), and soft assertions (one arrange/act, many checks). The goal is precise failure localization at acceptable cost — not maximum test count.

8. Recovery across lifecycle and context changes

Test replay after a lost response both while the original operation is pending and after its effect has committed or completed. Assert recovery of the original operation identity and outcome without applying its effect again. Also leave a context with unresolved work, visit another, then return; verify that recovery remains available in its original context. Keep controls for a deliberate new operation and a foreign context, so replay safety does not collapse distinct operations or reuse another context's state.

When to use / not

  • Use for designing or reviewing test structure/quality.
  • Not the place for the red-green-refactor loop, or test-double strategy (fakes-vs-mocks) — see the upstream TDD skills and [[prefer-fakes-over-mocks]].

Per-language bindings

  • Python (pytest): AAA with blank lines; @pytest.mark.parametrize with ids=[...] for labels; soft checks via pytest.raises/pytest-check or grouping asserts on one object; descriptive test_<behavior>_when_<condition> names.
  • Kotlin/JVM (JUnit5 / Kotest): backtick sentence names (`returns 404 when run id unknown`); assertAll {} (JUnit) / assertSoftly {} (Kotest) for one-concept multi-property; @ParameterizedTest + @MethodSource with named args; comments rare.
  • TypeScript (vitest/jest): describe/it('returns 404 when ...'); expect.soft(...) for multi-property one-concept; it.each([...]) (table) with a label template.
  • Go: table-driven with t.Run(tc.name, ...); each case named; t.Run subtests localize failures; require for fatal preconditions, assert for soft checks.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.