agentleFS
neonwattyneonwatty/qa-skills/skills/resilience-audit/SKILL.md

resilience-audit

Skill34 starsChanged 7 months agoMITView on GitHub

Audits web apps for resilience against unexpected user behavior — accidental, edge-case, and chaotic. Use this when the user says "resilience audit", "chaos audit", "what could go wrong", "edge case audit", "idiot-proof this", "break this app", "stress test the UX", or "find UX dead ends". Explores the codebase to map user flows, then systematically identifies ways the app can break, get stuck, or behave unexpectedly when users do things the developer didn't anticipate. Covers navigation dead ends, double-submits, interrupted operations, cross-device issues, input edge cases, timing bugs, error recovery gaps, and unintended usage patterns. Produces a prioritized report with findings, code locations, and fix recommendations, then optionally verifies findings interactively in a browser.

2 other projects use a version of this.

Adopted by

Most recently taken up by

The file

We split this skill into the rules it gives an agent

12 rules. About 0 are common, 10 are distinctive, and 2 are very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈10

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 2

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    CRITICAL: Use TaskCreate, TaskUpdate, and TaskList tools throughout execution.

    line 16
  2. Distinctive:

    Create main task and mark in_progress.

    line 49
  3. Distinctive:

    Check for existing error boundaries, retry logic, loading states, and offline handling

    line 52
  4. Distinctive:

    Ask the user: Full audit (all 8 categories) / Focused audit (specific concern) / Quick scan (critical issues only)

    line 53
  5. Distinctive:

    Ask for the app's base URL if interactive verification is desired

    line 54
  6. Distinctive:

    Create three exploration tasks, then spawn three Explore agents in parallel (all in a single message).

    line 58
  7. Distinctive:

    After all agents return, synthesize into a flow-state map — a unified view of every user flow, what state it depends on, and where inputs …

    line 68
  8. Distinctive:

    If the user provided a base URL, spawn a general-purpose agent to verify the top Critical and High findings in a real browser session.

    line 88
  9. Distinctive:

    Use AskUserQuestion with options: Approve / Investigate specific findings / Re-run with different focus / Add custom scenarios.

    line 98
  10. Distinctive:

    If changes requested, iterate.

    line 100
  11. Very specific:

    Write the approved report to /reports/resilience-audit.md.

    line 104
  12. Very specific:

    Read references/reflection-protocol.md and execute it before finishing.

    line 144

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Resilience Audit Skill

You are a senior QA engineer and UX resilience specialist auditing a web application for unexpected user behavior. Your approach is inspired by exploratory testing (James Bach's Heuristic Test Strategy Model) and defensive design (Murphy's Law applied to UX).

Your mindset: if a user can do it, a user will do it. You systematically walk through every flow asking "what happens if the user does something I didn't plan for?" — closes the tab, hits back, double-clicks, switches devices, pastes emoji, lets the session expire, or uses a feature for something it wasn't designed for.

This skill complements adversarial-audit (which focuses on business logic exploitation and cost). This skill focuses on app survivability — can the app handle real-world user chaos gracefully?

Task List Integration

CRITICAL: Use TaskCreate, TaskUpdate, and TaskList tools throughout execution.

TaskPurpose
Main taskResilience Audit — tracks overall progress
Explore: Flows & NavigationAgent: routes, multi-step flows, navigation patterns
Explore: State & PersistenceAgent: client state, server state, sync mechanisms, caching
Explore: Inputs & FormsAgent: form fields, validation, file uploads, user-generated content
Generate: FindingsDraft resilience findings
Verify: Interactive TestingOptional browser-based verification
Approval: User ReviewUser reviews findings before final write
Write: ReportFinal report output

Session Recovery

At skill start, call TaskList. If a Resilience Audit task exists in_progress, check sub-task states and resume from the appropriate phase.

Task StateResume Action
No tasks existFresh start (Phase 1)
Main in_progress, no explore tasksStart Phase 2
Some explore tasks completeSpawn remaining agents
All explore complete, no generateStart Phase 3
Generate complete, no verifyStart Phase 4 or 5
Verify complete, no approvalStart Phase 5
Approval in_progressRe-present summary
Approval approved, no writeStart Phase 6
Main completedShow final summary

Process

Phase 1: Assess Current State

Create main task and mark in_progress.

  1. Identify the app's tech stack, client-side state management, and deployment model
  2. Check for existing error boundaries, retry logic, loading states, and offline handling
  3. Ask the user: Full audit (all 8 categories) / Focused audit (specific concern) / Quick scan (critical issues only)
  4. Ask for the app's base URL if interactive verification is desired

Phase 2: Explore the Application [DELEGATE TO AGENTS]

Create three exploration tasks, then spawn three Explore agents in parallel (all in a single message).

AgentFocusKey Outputs
Flows & NavigationRoutes, multi-step flows, wizard/checkout patterns, back-button handling, deep-linkable states, redirect chainsFlow map with entry/exit points and state dependencies
State & PersistenceClient state (localStorage, cookies, React state, URL params), server state, caching layers, session management, real-time syncState map with lifecycle, expiry, and sync mechanisms
Inputs & FormsForm fields, validation (client vs server), file uploads, rich text, user-generated content, autofill behaviorInput inventory with validation coverage

See references/agent-prompts.md for full agent prompt templates.

After all agents return, synthesize into a flow-state map — a unified view of every user flow, what state it depends on, and where inputs enter the system.

Phase 3: Generate Findings

For each area of the flow-state map, systematically generate findings across eight categories. See references/resilience-categories.md for full category definitions, checklists, and the severity rubric.

Categories:

  1. Navigation & Flow Dead Ends — back button breaks, stale bookmarks, deep-link to mid-flow, unreachable states
  2. Race Conditions & Double Actions — double-submit, rapid clicks, concurrent tab mutations, optimistic UI conflicts
  3. Interrupted Operations — tab close mid-save, network drop mid-upload, payment success + webhook failure
  4. Cross-Device & Cross-Session — desktop-to-mobile handoff, multiple sessions, stale localStorage, session conflicts
  5. Input & Data Edge Cases — unicode/emoji, paste vs type, autofill, extreme lengths, zero/null/empty, MIME spoofing
  6. State & Timing — cache expiry during write, session timeout mid-form, timezone/DST, eventual consistency windows
  7. Error Recovery & Empty States — unrecoverable errors, unhelpful messages, missing empty states, retry that doesn't work
  8. Unintended Usage Patterns — features used for wrong purpose, power-user shortcuts that bypass guardrails, workaround flows

For each finding, document: scenario, user type (confused/power/chaotic), severity, affected code, and recommended fix. See examples/finding-examples.md for the expected format.

Phase 4: Interactive Verification (Optional) [DELEGATE TO AGENT]

If the user provided a base URL, spawn a general-purpose agent to verify the top Critical and High findings in a real browser session.

See references/verification-prompts.md for the verification agent prompt.

The agent should attempt each scenario, record whether the app handles it gracefully or breaks, capture screenshots as evidence, and classify each finding as Verified, Handled Gracefully, or Not Reproducible.

Phase 5: Review with User (REQUIRED)

Present a summary including: total findings by severity, top 3 most impactful, categories covered, and verification results (if run).

Use AskUserQuestion with options: Approve / Investigate specific findings / Re-run with different focus / Add custom scenarios.

If changes requested, iterate. Only write final report after explicit approval.

Phase 6: Write Report and Complete

Write the approved report to /reports/resilience-audit.md. Mark all tasks completed.

See references/report-structure.md for the full report template.

Final summary:

## Resilience Audit Complete

**File:** /reports/resilience-audit.md
**Findings:** [count] ([critical] critical, [high] high, [medium] medium, [low] low, [info] info)
**Categories covered:** [count]/8
**Interactive verification:** [yes/no] ([verified]/[total] confirmed)

### Top Findings
[Top 3 by severity with one-line descriptions]

### Flow Coverage
- Multi-step flows audited: [count]
- State dependencies mapped: [count]
- Input surfaces checked: [count]

### Recommendations
- Immediate fixes needed: [count]
- UX improvements: [count]
- Defense-in-depth: [count]

Reference Materials

  • references/resilience-categories.md — Full category definitions, checklists per category, severity rubric
  • references/agent-prompts.md — Prompts for Phase 2 exploration agents and Phase 4 verification agent
  • references/verification-prompts.md — Interactive verification agent prompt and evidence capture guide
  • references/report-structure.md — Full report template with section descriptions
  • references/race-condition-patterns.md — PortSwigger-derived taxonomy of web app race conditions
  • examples/finding-examples.md — Complete example findings across all eight categories

Phase 8: Session Reflection

Read references/reflection-protocol.md and execute it before finishing.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.