agentleFS
kenhuanguskenhuangus/defense-factory-skills/skills/triage-validate-finding/SKILL.md

triage-validate-finding

Skill2 starsChanged 47 days agoMITView on GitHub

Dynamically reproduces finding candidates with authorization and writes validated findings for the Defense Factory Dynamic validation phase. Static-only results stay candidates; refuse unauthorized Red testing.

We split this skill into the rules it gives an agent

4 rules. About 0 are common, 2 are distinctive, and 2 are very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈2

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 2

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Never use to attack unauthorized systems

    line 15
  2. Very specific:

    Cannot reproduce: leave as candidate; document attempts in a sibling .md file—do not mark validated

    line 33
  3. Very specific:

    Write validated file to .defense-factory/findings/validated/<id>.json.

    line 34
  4. Distinctive:

    Do not expand into unrelated offensive tooling development.

    line 52

≈ “Common” is an estimate: at least 1 in 5 of the 308,232 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

triage-validate-finding

Phase: Dynamic validation
Style: Blue triage + authorized Red reproduction only

When to use

  • Candidates exist under .defense-factory/findings/candidates/
  • User requests confirmation before ownership or fix work
  • Never use to attack unauthorized systems

Preconditions

  1. Explicit ownership or written authorization referenced in SECURITY.md or a ticket id.
  2. Safe environment for reproduction (prefer staging/lab over production).
  3. Candidate JSON files present and schema-valid.

Procedure

  1. Load candidate; confirm asset_id is in-scope.
  2. Record authorization_ref (SECURITY.md section + ticket/email id).
  3. Attempt minimal dynamic reproduction sufficient to prove impact:
    • Authorized requests, config checks, or controlled exploit replay against owned/authorized targets only
    • Capture redacted request/response or logs under .defense-factory/findings/validated/<id>/
  4. Decision:
    • Validated: set status to validated, evidence.dynamic to true, include reproduction_steps, observed_behavior, expected_behavior, proof_artifacts, authorization_ref
    • False positive: set status to false_positive with short rationale; keep under candidates or move to findings/duplicates/ with note
    • Cannot reproduce: leave as candidate; document attempts in a sibling .md file—do not mark validated
  5. Write validated file to .defense-factory/findings/validated/<id>.json.
  6. Validate:
python <skills-repo>\scripts\validate_artifacts.py .defense-factory\findings\validated\<id>.json --schema finding

Required outputs

PathRule
.defense-factory/findings/validated/<id>.jsonMust include dynamic evidence
.defense-factory/findings/validated/<id>/*Redacted proof artifacts

Stop / refuse

  • Refuse reproduction against systems lacking ownership or written authorization.
  • Refuse to mark validated when only static analyzer output exists.
  • Do not expand into unrelated offensive tooling development.

Next phase

dedupe-findings, then route-ownership.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.