dev-smoke
Skill1.7k starsChanged 28 days agoApache-2.0View on GitHub
AI DevKit · Smoke-test the user flows a change affects (CLI, API, UI) end to end with a disposable sandboxed script against the real app. Use before calling a feature or fix done, when unit tests pass but the flow is untested, or when users ask for a smoke, e2e, or impact check.
Adopted by
Steady: 0 new projects took it in the last 4 weeks, none the 4 weeks before.thin data
Who's talking about codeaholicguy/ai-devkit
- A Hacker News story“I collected all valuable AI Skills repositories”Hacker News · Feb 3, 2026 · 2 points
- A Hacker News story“AI-Devkit”Hacker News · Oct 16, 2025 · 1 points
- sudosubin/agents.nix“agent-skills.github.codeaholicguy.ai-devkit: 0-unstable-2026-11-07 → 0-unstable-2026-11-08”GitHub · Nov 8, 2026
- sudosubin/agents.nix“agent-skills.github.codeaholicguy.ai-devkit: 0-unstable-2026-11-01 → 0-unstable-2026-11-07”GitHub · Nov 7, 2026
- sudosubin/agents.nix“codex-plugins.github.codeaholicguy.ai-devkit: 0-unstable-2026-11-04 → 0-unstable-2026-11-07”GitHub · Nov 7, 2026
The biggest 5 of 42 mentions linking to the repository that our crawl found. Each line is their own headline.
See all 42
Talked about on GitHub and Hacker News (42 times).
On GitHub · 40
- Nov 8, 2026agent-skills.github.codeaholicguy.ai-devkit: 0-unstable-2026-11-07 → 0-unstable-2026-11-08 — sudosubin/agents.nix0 reactions
- Nov 7, 2026agent-skills.github.codeaholicguy.ai-devkit: 0-unstable-2026-11-01 → 0-unstable-2026-11-07 — sudosubin/agents.nix0 reactions
- Nov 7, 2026codex-plugins.github.codeaholicguy.ai-devkit: 0-unstable-2026-11-04 → 0-unstable-2026-11-07 — sudosubin/agents.nix0 reactions
- Nov 4, 2026codex-plugins.github.codeaholicguy.ai-devkit: 0-unstable-2026-11-03 → 0-unstable-2026-11-04 — sudosubin/agents.nix0 reactions
- Nov 3, 2026codex-plugins.github.codeaholicguy.ai-devkit: 0-unstable-2026-11-01 → 0-unstable-2026-11-03 — sudosubin/agents.nix0 reactions
35 more on GitHub
- Nov 1, 2026agent-skills.github.codeaholicguy.ai-devkit: 0-unstable-2026-10-28 → 0-unstable-2026-11-01 — sudosubin/agents.nix0 reactions
- Nov 1, 2026codex-plugins.github.codeaholicguy.ai-devkit: 0-unstable-2026-10-29 → 0-unstable-2026-11-01 — sudosubin/agents.nix0 reactions
- Oct 29, 2026codex-plugins.github.codeaholicguy.ai-devkit: 0-unstable-2026-10-28 → 0-unstable-2026-10-29 — sudosubin/agents.nix0 reactions
- Oct 29, 2026agent-skills.github.codeaholicguy.ai-devkit: 0-unstable-2026-10-25 → 0-unstable-2026-10-28 — sudosubin/agents.nix0 reactions
- Oct 29, 2026codex-plugins.github.codeaholicguy.ai-devkit: 0-unstable-2026-10-25 → 0-unstable-2026-10-28 — sudosubin/agents.nix0 reactions
- Oct 25, 2026agent-skills.github.codeaholicguy.ai-devkit: 0-unstable-2026-10-23 → 0-unstable-2026-10-25 — sudosubin/agents.nix0 reactions
- Oct 25, 2026codex-plugins.github.codeaholicguy.ai-devkit: 0-unstable-2026-10-24 → 0-unstable-2026-10-25 — sudosubin/agents.nix0 reactions
- Oct 24, 2026codex-plugins.github.codeaholicguy.ai-devkit: 0-unstable-2026-10-23 → 0-unstable-2026-10-24 — sudosubin/agents.nix0 reactions
- Oct 23, 2026codex-plugins.github.codeaholicguy.ai-devkit: dc8509c → 86af9b6 — sudosubin/agents.nix0 reactions
- Oct 23, 2026agent-skills.github.codeaholicguy.ai-devkit: 5dc438c → 3f90d45 — sudosubin/agents.nix0 reactions
- Oct 23, 2026codex-plugins.github.codeaholicguy.ai-devkit: 08f1a74 → dc8509c — sudosubin/agents.nix0 reactions
- Oct 23, 2026agent-skills.github.codeaholicguy.ai-devkit: 0-unstable-2026-10-18 → 0-unstable-2026-10-23 — sudosubin/agents.nix0 reactions
- Oct 23, 2026codex-plugins.github.codeaholicguy.ai-devkit: 007cbd0 → 08f1a74 — sudosubin/agents.nix0 reactions
- Oct 23, 2026codex-plugins.github.codeaholicguy.ai-devkit: 0-unstable-2026-10-18 → 0-unstable-2026-10-23 — sudosubin/agents.nix0 reactions
- Oct 18, 2026agent-skills.github.codeaholicguy.ai-devkit: 0-unstable-2026-10-11 → 0-unstable-2026-10-18 — sudosubin/agents.nix0 reactions
- Oct 18, 2026codex-plugins.github.codeaholicguy.ai-devkit: 0-unstable-2026-10-17 → 0-unstable-2026-10-18 — sudosubin/agents.nix0 reactions
- Oct 17, 2026codex-plugins.github.codeaholicguy.ai-devkit: 0-unstable-2026-10-16 → 0-unstable-2026-10-17 — sudosubin/agents.nix0 reactions
- Oct 16, 2026codex-plugins.github.codeaholicguy.ai-devkit: 0-unstable-2026-10-15 → 0-unstable-2026-10-16 — sudosubin/agents.nix0 reactions
- Oct 15, 2026codex-plugins.github.codeaholicguy.ai-devkit: 475f4b9 → cea04b3 — sudosubin/agents.nix0 reactions
- Oct 15, 2026codex-plugins.github.codeaholicguy.ai-devkit: 0-unstable-2026-10-14 → 0-unstable-2026-10-15 — sudosubin/agents.nix0 reactions
- Oct 14, 2026codex-plugins.github.codeaholicguy.ai-devkit: 66d2ea6 → 9eae9bf — sudosubin/agents.nix0 reactions
- Oct 14, 2026codex-plugins.github.codeaholicguy.ai-devkit: 0-unstable-2026-10-12 → 0-unstable-2026-10-14 — sudosubin/agents.nix0 reactions
- Oct 13, 2026codex-plugins.github.codeaholicguy.ai-devkit: 0-unstable-2026-10-06 → 0-unstable-2026-10-12 — sudosubin/agents.nix0 reactions
- Oct 13, 2026agent-skills.github.codeaholicguy.ai-devkit: 0-unstable-2026-10-04 → 0-unstable-2026-10-11 — sudosubin/agents.nix0 reactions
- Oct 7, 2026codex-plugins.github.codeaholicguy.ai-devkit: b614d94 → 7ef0cd5 — sudosubin/agents.nix0 reactions
- Oct 6, 2026codex-plugins.github.codeaholicguy.ai-devkit: 0-unstable-2026-10-04 → 0-unstable-2026-10-06 — sudosubin/agents.nix0 reactions
- Oct 4, 2026codex-plugins.github.codeaholicguy.ai-devkit: init at 0-unstable-2026-10-04 — sudosubin/agents.nix0 reactions
- Oct 4, 2026agent-skills.github.codeaholicguy.ai-devkit: 0-unstable-2026-09-27 → 0-unstable-2026-10-04 — sudosubin/agents.nix0 reactions
- Oct 3, 2026agent-skills.github.codeaholicguy.ai-devkit: 0.61.0-unstable-2026-09-20 → 0-unstable-2026-09-27 — sudosubin/agents.nix0 reactions
- Sep 26, 2026[Candidate] codeaholicguy/ai-devkit/skills/agent-orchestration - agent-orchestration — ProSkillsMD/proskills0 reactions · 2 comments
- Sep 26, 2026[Candidate] codeaholicguy/ai-devkit/skills/agent-management - agent-management — ProSkillsMD/proskills0 reactions · 2 comments
- Sep 26, 2026[Candidate] codeaholicguy/ai-devkit/skills/agent-communication - agent-communication — ProSkillsMD/proskills0 reactions · 1 comment
- Sep 26, 2026agent-skills.github.codeaholicguy.ai-devkit: init at 0.61.0-unstable-2026-09-20 — sudosubin/agents.nix0 reactions
- Aug 27, 2026[Resource]: AI DevKit — hesreallyhim/awesome-claude-code0 reactions · 1 comment
- Apr 18, 2026Audit candidate: codeaholicguy/ai-devkit — xiaolai/nlpm0 reactions · 4 comments
On Hacker News · 2
- Feb 3, 2026I collected all valuable AI Skills repositories2 points
- Oct 16, 2025AI-Devkit1 point
In this repository30 other files it gives its agents.
- agent-communicationSkill
- agent-managementSkill
- agent-orchestrationSkill
- ai-devkit-setupSkill
- brainstormSkill
- changelogSkill
- dev-commitSkill
- dev-debugSkill
- dev-designSkill
- dev-implementationSkill
- dev-lifecycleSkill
- dev-planningSkill
- dev-prSkill
- dev-refactorSkill
- dev-requirementsSkill
- dev-retroSkill
- dev-reviewSkill
- dev-simplifySkill
- dev-testingSkill
- dev-worktreeSkill
- document-codeSkill
- memorySkill
- remote-from-slackSkill
- remote-from-telegramSkill
- security-reviewSkill
- session-compactSkill
- taskSkill
- tddSkill
- technical-writerSkill
- verifySkill
The file
We split this skill into the rules it gives an agent
10 rules. About 0 are common, 10 are distinctive, and 0 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈10
Distinctive · estimate
This author's own choices. Worth a look.
0
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 14
Never use production, shared environments, real accounts or credentials, or paid APIs.
- Distinctive: line 15
Start servers on a dedicated port, wait until they respond, and stop the whole process tree on exit.
- Distinctive: line 16
Keep secrets out of the script and its output.
- Distinctive: line 17
Write the script outside the repo.
- Distinctive: line 22
Read the change: git diff against the base branch, plus untracked files.
- Distinctive: line 26
Run it and read the full output.
- Distinctive: line 29
Delete the script and sandbox, or offer to promote valuable checks into permanent tests or the project's release smoke suite.
- Distinctive: line 33
Use the harness's browser tool when available (for example Claude in Chrome or a Playwright MCP server).
- Distinctive: line 34
Use a fresh browser context per check, and act like a user: navigate, click, fill forms, submit.
- Distinctive: line 38
Not covered: native mobile apps, desktop apps, pixel-level visual diffs.
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Smoke
Exercise the flows a change touches the way a user would, then throw the script away. Report with verify; use dev-testing for permanent tests.
Rules
- Drive the real entry point: built binary, running server, CLI, UI, or job. Imported functions and mocks are not smoke checks.
- Sandbox everything: temp dir, isolated
HOMEand config, empty git hooks, seeded test data, test accounts and tokens. - Never use production, shared environments, real accounts or credentials, or paid APIs. Ask before outward-facing side effects: messages, emails, webhooks, deploys, pushes.
- Start servers on a dedicated port, wait until they respond, and stop the whole process tree on exit. Never reuse or kill the user's own servers.
- Keep secrets out of the script and its output.
- Write the script outside the repo; commit it only if the user asks to promote it.
- Timebox setup. If the app cannot run locally, say what was not checked instead of faking a pass.
Workflow
- Read the change:
git diffagainst the base branch, plus untracked files. - Map impact outward: changed symbols -> callers -> entry points (commands, routes, screens, jobs, hooks, config, migrations) -> user flows. Add adjacent flows sharing the changed code, config, or data; note skipped flows and why.
- List scenarios as setup / action / expected result, ordered by risk. Wait for the user to add or cut flows; when running unattended, proceed and include the list in the report.
- Search memory for known setup:
npx ai-devkit@latest memory search --query "<project> smoke setup" --tags "smoke". Build once, then write the script fromreferences/smoke-template.sh(CLI, API) orreferences/web-smoke-template.mjs(browser). Each check asserts output, files, HTTP status, or exit code, not just "it ran"; API checks also assert the body and one error case (bad input, missing auth). Print PASS/FAIL per check and exit non-zero on any failure. - Run it and read the full output.
- On a failure, first rule out a wrong check (selector, timing, setup), then rerun it on the base commit in a separate worktree (
dev-worktree) to separate regressions from pre-existing failures. - Report with
verify: scenarios, command, exit code, per-check result, pre-existing failures, flows not covered. - Delete the script and sandbox, or offer to promote valuable checks into permanent tests or the project's release smoke suite. Store non-obvious setup:
npx ai-devkit@latest memory store --title "<project> smoke setup" --content "<start command, port, health URL, seeding, traps>" --tags "smoke".
UI and Web
- Use the harness's browser tool when available (for example Claude in Chrome or a Playwright MCP server); otherwise the web template, with Playwright installed in the sandbox.
- Use a fresh browser context per check, and act like a user: navigate, click, fill forms, submit.
- Assert visible content, URL, network status, and zero console errors, not just that the page loaded. Match visible elements by role or text; hidden duplicates (mobile menus, templates) cause false failures.
- UI impact includes shared components, layouts, global styles, and every route rendering the changed component. Check narrow viewports or dark mode when layout or theming changed.
- Save a screenshot per check as evidence, and read it before judging a failure.
- Not covered: native mobile apps, desktop apps, pixel-level visual diffs. Report them as unchecked.
Stop
Pause when impacted flows are unclear, a scenario needs anything the Rules forbid, setup needs destructive actions, or failures come from the environment rather than the change.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

