test-automation
Skill2 starsChanged 7 days agoApache-2.0View on GitHub
Write or run deterministic automated test specs (Playwright or WebdriverIO) via the CLI runner — for regression, repeatable checks, nightly-style suites. Use for "/test-automation", "automate this flow", "Autotest schreiben", "run the regression suite", or flows understood and worth repeating.
6 other projects use a version of this.
Adopted by
Most recently taken up by
- AxlZero21/Skillstheir own version, first seen Nov 8, 2026
- upex-galaxy/agentic-qa-boilerplatetheir own version, first seen Nov 7, 2026
- Marina-Gajego/qa-skillstheir own version, first seen Nov 1, 2026
- mejbaurbahar/software-tester-skillstheir own version, first seen Oct 13, 2026
- mejbaurbahar/faguntheir own version, first seen Jul 5, 2026
- StephanSergio/vibe-stacktheir own version, first seen Jun 20, 2026
Other versions6 projects use a version of this.
Word for word · 0
None found.
Edited · 0
None found.
Wrote their own version · 6
- upex-galaxy/agentic-qa-boilerplate★ 26same name
- Marina-Gajego/qa-skills★ 5same name
- AxlZero21/Skills★ 1same name
- mejbaurbahar/fagun★ 1same name
- mejbaurbahar/software-tester-skills★ 1same name
- StephanSergio/vibe-stack★ 0same name
How matches are found. Word for word: the exact same text. Edited: shares passages with this file (“99% same” means 99% of its five-word phrases also appear here; 10% or more counts). Their own version: similar meaning, or, weakest, the same name. We can’t tell which project had it first. Projects are counted among the 200 most-starred candidates, and mentions are links to the repository we found, up to 50 per site, so both counts are a floor.
In this repository34 other files it gives its agents.
- AGENTS.mdAGENTS.md
- CLAUDE.mdCLAUDE.md
- accessibility-testingSkill
- agentswitchSkill
- api-testingSkill
- bug-reportSkill
- bug-reproductionSkill
- demoSkill
- deploy-to-stageSkill
- exploratory-testingSkill
- failure-analysisSkill
- model-setupSkill
- onboard-productSkill
- onboard-projectSkill
- perf-analysisSkill
- qa-helpSkill
- qa-metricsSkill
- qa-reportSkill
- re-boardSkill
- reconSkill
- release-readinessSkill
- report-to-jiraSkill
- retest-bugSkill
- retro-learnSkill
- risk-based-testingSkill
- scaffold-suiteSkill
- security-testingSkill
- skill-reviewSkill
- test-case-managementSkill
- test-reliabilitySkill
- test-ticketSkill
- visual-testingSkill
- webdriverio-testingSkill
- whats-newSkill
The file
We split this skill into the rules it gives an agent
6 rules. 0 are common, 2 are distinctive, and 4 are very specific to this project.
0
Common
Most of the 6 edited versions we read keep these.
2
Distinctive
This author's own choices. Worth a look.
4
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Very specific: line 9
When a run-scoped context-capsule.json path is supplied, consume its exact intake, routing, execution controls, test assets and selected …
- Very specific: line 23
Use the capsule's "Test assets" for the suite's framework and location (often a separate repo checkout).
- Very specific: line 36
Use relevant capsule Learning excerpts first.
- Very specific: line 75
Preflight before any long unattended run: Run the blueprint's preflight.sh <KEY> — it probes stage/JIRA reachability (incl.
- Distinctive: line 100
If teardown is genuinely impossible (no API, data not deletable), say so in the execution summary and name the residue by count and kind.
- Distinctive: line 102
When many independent cases suddenly block or fail together, suspect the environment first — leftover test data, a stale deployment, a dead …
“Common” is measured: kept by at least 6 in 10 of the 6 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
/test-automation — CLI-driven specs
When a run-scoped context-capsule.json path is supplied, consume its exact intake,
routing, execution controls, test assets and selected Learnings. Do not fully read
PROJECT/PRODUCT, route again or repeat mode/framework/suite lookup and merging.
Forward the capsule path to test-automator; targeted existing-spec, recon,
framework-convention and new-symptom Learning reads remain allowed. Return
STALE_CONTEXT instead of repairing a stale capsule. Direct standalone runs without
a capsule retain the effective-project fallback below.
Steps
- Resolve scope first: a suite run started from a ticket inherits that ticket's
product; a scheduled/headless run must be told
(
/test-automation --project SHOP --product ADMIN), because there is no ticket to route from and the TC namespace is product-specific. - Use the capsule's "Test assets" for the suite's framework and location
(often a separate repo checkout). Only without a capsule, read
projects/<KEY>/PROJECT.mdand any routedPRODUCT.md. In either mode, check whether a spec for this flow already exists. - Delegate to subagent
test-automatorwith the capsule path when supplied. Usetest-automator-deeponly when reliable capsule intake marks high risk or this execution branch is escalated; otherwise use the standard agent. Missing or unknown risk means standard, and neither mode nor escalation is changed by the model-lane choice: write/extend the spec per the framework's conventions — Playwright:docs/rules/testing/playwright-cli.md(TC-ID title, AAA structure, web-first assertions); WebdriverIO: thewebdriverio-testingskill — or run the existing suite/subset relevant to the ticket. - Use relevant capsule Learning excerpts first. Without a capsule, or for a new
symptom not covered by them, check
memory/learnings/flaky-tests.mdandselector-failures.mdnarrowly — don't rediscover a known issue. 3b. Never write a spec blind. When the flow was not observed yet, run/reconfirst and take selectors from itsrecon.json(roles + accessible names), never from guesses. Assertions are positive and specific (what should be visible — concrete text/value/state), negative ones only supplementary. Every test title carries the AC-ID next to the TC-ID ('AC2 / TC-CHK-014: …'). Full rules:docs/pipeline/04-execution.md. 3c. Red check for new specs (PROJECT.md → "Execution mode" →Red check required, default yes): before a new spec's green counts as evidence, prove it red once — violate the expectation via data/state, or briefly invert the assertion. A spec that survives its own red check attempt does not check what it claims (docs/pipeline/05-verification.md). 3d. Observation channel on every run: console errors, responses ≥ 400, load times over threshold, end-of-test screenshot — collected independently of the assertions and reported as Observations, even on a fully green run. That is the part of the live eye a spec otherwise lacks. - Produce evidence (report, trace-on-failure,
run.jsonrun record with TC-IDs/outcomes/timing/mode perdocs/pipeline/04-execution.md,execution_summary.json) per.claude/rules/core/evidence-policy.md— includingtest_cases[], which the CLI runner is the only source of and which every later failure analysis depends on. The summary'sskills_usedlists the skills this run actually invoked (test-automation,reconwhen one ran,webdriverio-testingwhen the WDIO path was used) — actually used, never planned. - On a failure, do not conclude anything yet.
failure-analysisreceives the failure packet and capsule path when available and decides whether the product broke or the test aged out; a red spec is a question, not a verdict. - Report pass/fail counts and flake occurrences; anything P0–P2 confirmed as a
product defect →
bug-report. A recurring flake or a new selector pattern worth generalizing →retro-learn.
Nightly / headless use
This skill is what a nightly-regression pipeline invokes via claude -p — see
docs/rules/core/cicd.md for headless-run constraints (no interactive
prompts, pre-authorized actions only).
Preflight before any long unattended run. Run the blueprint's
preflight.sh <KEY> — it probes stage/JIRA reachability (incl. multiple-VPN
detection) and secrets status, and the pre-tool guard enforces a fresh pass
for browser/JIRA MCP calls. Additionally verify the suite's smoke spec passes
solo. A dead harness costs a whole night of BLOCKED cases (field report
2026-09: 11 cases lost to an MCP server down at the connection level). A
failed preflight is one BLOCKED report with the reason — never a retry loop
against a dead server; reconnecting it is a human step.
failure-analysis still runs headless — the analysis is the useful part and it
costs one JQL — but the NEEDS_REVIEW verdict is unreachable there: a nightly writes
FAIL with the class and the proposal attached, and a human picks it up in the
morning. A pipeline that went green on "the test was probably outdated" would be
worse than one that went red.
Test-data hygiene
Specs that create data tear it down (afterEach/cleanup hook) — cleanup is
part of the spec, not optional polish. A suite that leaves artifacts behind
degrades the shared tenant, and a degraded tenant then fails unrelated
cases (field report 2026-09: 23 leftover test entities slowed rendering until
fresh, correct objects timed out — 13 cases "blocked" by clutter, and one
failure cascade where one spec's leftover popover blocked 20 others). Two
consequences:
- If teardown is genuinely impossible (no API, data not deletable), say so in the execution summary and name the residue by count and kind.
- When many independent cases suddenly block or fail together, suspect the environment first — leftover test data, a stale deployment, a dead service — and record the cause as environment, not as a product defect. Re-run after the next redeploy/cleanup before concluding anything.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

