agentleFS
nledfordnledford/engineering-review-board/skills/security-review-evidence/SKILL.md

security-review-evidence

Skill11 starsChanged 12 days agoMITView on GitHub

Companion evidence checklist for security-sensitive changes and reviews. Use only with security-review, threat-modeling, or dependency-supply-chain-review to keep evidence sanitized, scoped, and tied to repository policy. Do not use as standalone security analysis.

  • Reads credentials

The file

Show its rules and text

We split this skill into the rules it gives an agent

14 rules. About 0 are common, 11 are distinctive, and 3 are very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈11

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 3

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  • could be automatic: a setting could enforce it
  1. Very specific:

    Use this skill when a change touches authentication, authorization, crypto, certificates, tokens, signatures, sessions, secrets, passwords, …

    line 9
  2. Very specific:

    Use this skill only as evidence support for the owning security workflow: security-review for implemented controls, threat-modeling for …

    line 15
  3. Distinctive:

    Prefer existing validation commands and evidence templates over inventing a new checklist.

    line 27
  4. Distinctive:

    If no repository policy exists, use this skill as the minimum evidence checklist and state that no project-specific policy was found.

    line 29
  5. Distinctive:

    Backup and log exposure: check whether backups, audit logs, telemetry, traces, crash reports, dependency audit output, or command output …

    line 75
  6. Very specific:

    Never print, commit, paste, publish, or attach .env contents, secret files, private keys, cookies, tokens, CSRF values, password hashes, …

    line 81
  7. Distinctive:

    Treat security traces, screenshots, videos, storage state, HAR/network dumps, downloads, reports, logs, credentialed URLs, live data, …

    line 90
  8. Distinctive:

    Prefer writing raw artifacts to documented local temporary or ignored artifact locations that can be deleted after review.

    line 95
  9. Distinctive:

    Before reporting, inspect artifact names and sanitized summaries for secrets, credentialed URLs, cookies, tokens, private paths, customer …

    line 101
  10. Distinctive:

    Delete or securely dispose of raw security artifacts after extracting sanitized evidence.

    line 104
  11. Distinctive:

    When cleanup cannot be verified, report all of the following:

    line 114
  12. Distinctive:

    Prefer repository-owned validation recipes when they exist.

    line 127
  13. Distinctive:

    Do not treat search output, screenshots containing secrets, or raw logs as shareable security evidence.

    line 129
  14. Distinctive:

    If verification is skipped or partial, report the missing control, why it was not checked, and the residual risk.

    line 131

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Security Review Evidence

Use this skill when a change touches authentication, authorization, crypto, certificates, tokens, signatures, sessions, secrets, passwords, CORS, CSP, CSRF, .env handling, credential handling, trust boundaries, security-sensitive input validation, file import/export paths, plugin or extension trust roots, browser artifacts, or related commands/docs.

Use this skill only as evidence support for the owning security workflow: security-review for implemented controls, threat-modeling for design-time risks, or dependency-supply-chain-review for dependency and provenance risk. This skill owns collection, redaction, and reporting guardrails, not the security analysis itself.

Source of Truth

  • First inspect the repository for security guidance such as SECURITY.md, AGENTS.md, docs/security*, threat models, runbooks, CI security jobs, or review templates.
  • Prefer existing validation commands and evidence templates over inventing a new checklist.
  • If no repository policy exists, use this skill as the minimum evidence checklist and state that no project-specific policy was found.

Evidence to Collect

  • Record pre-change and post-change security evidence for each security-sensitive change; if a checkpoint is impossible, say why.
  • Name the affected route classes, commands, docs, helper scripts, deployment surfaces, browser artifacts, storage paths, or trust boundaries.
  • Cover authentication, authorization, sessions, CORS, CSP, CSRF, MFA, throttling, and secret handling where applicable.
  • For secrets and credentials, record lifecycle checkpoints for generation, storage, scope, rotation, revocation, destruction, backup/log exposure, fixture or test handling, and post-test cleanup. Use sanitized control names and locations, never raw values.
  • For import/export or filesystem work, confirm raw host paths, canonical paths, cache payloads, task payloads, and command output are redacted where needed.
  • For plugin, extension, or script execution work, identify trust roots, managed roots, path boundaries, and untrusted inputs without exposing private filesystem details.
  • For dependency or supply-chain work, capture sanitized evidence for the package, binary, script, generated code, lockfile, provenance, checksum or signature, install hooks, advisory state, and dependency-audit result. Redact private registry hosts, tokens, credentials, local cache paths, and customer or organization names when they are sensitive.
  • For browser/frontend evidence, treat screenshots, traces, videos, storage state, HAR/network dumps, downloads, reports, credentialed URLs, and live data as local ignored artifacts by default. Record sanitized artifact classes, redactions, policy or explicit approval, access boundary, and cleanup evidence before anything is retained or shared.

Secrets and Credential Lifecycle Checkpoints

  • Generation: identify the approved generator or secret source, required entropy, uniqueness, TTL, and whether test fixtures use deterministic or fake values instead of live credentials.
  • Storage: identify the storage class only, such as secret manager, CI variable, keychain, encrypted database column, or local test fixture. Do not name or print the secret value, .env contents, raw DSN, or private file path.
  • Scope: record the intended audience, permissions, tenant/project boundary, environment, expiration, and least-privilege constraints.
  • Rotation and revocation: confirm the rotation path, revocation trigger, rollback behavior, and how old credentials become unusable.
  • Destruction and cleanup: confirm generated test credentials, temporary tokens, fixture accounts, temporary keys, and local secret files are deleted, expired, revoked, or replaced with non-live placeholders after verification.
  • Backup and log exposure: check whether backups, audit logs, telemetry, traces, crash reports, dependency audit output, or command output could retain credential material. Record only sanitized results.

Forbidden Outputs

Never print, commit, paste, publish, or attach .env contents, secret files, private keys, cookies, tokens, CSRF values, password hashes, credential material, credentialed database URLs, browser storage state, raw import paths, raw browser artifacts, or private host paths. Use placeholders such as <redacted>, <local-secret-file>, <credentialed-url>, <private-registry>, or <private-path>.

Artifact Cleanup Expectations

  • Treat security traces, screenshots, videos, storage state, HAR/network dumps, downloads, reports, logs, credentialed URLs, live data, dependency audit output, temporary databases, export files, reproduced exploit payloads, fuzzing/minimized payloads, and generated fixtures as sensitive until reviewed and cleaned.
  • Prefer writing raw artifacts to documented local temporary or ignored artifact locations that can be deleted after review. Do not move raw artifacts into the repository, issue trackers, PR comments, shared chat, or persistent reports.
  • The safe override path for sharing or retention is: sanitized artifact, documented repository policy or explicit approval, and security evidence that records redactions, retained class/location, access boundary, and cleanup.
  • Before reporting, inspect artifact names and sanitized summaries for secrets, credentialed URLs, cookies, tokens, private paths, customer data, exploit payloads, and private dependency or registry details.
  • Delete or securely dispose of raw security artifacts after extracting sanitized evidence. If retention is required by project policy or explicit approval, record the retention class, access boundary, and cleanup/expiry expectation without exposing private paths or contents.
  • Clean temporary databases, local export files, fixture credentials, generated payload files, and dependency audit logs after tests. Prefer automated cleanup in tests or teardown scripts over manual deletion.

Reporting Cleanup Gaps

When cleanup cannot be verified, report all of the following:

  • Artifact or credential class, not the raw path or value.
  • What cleanup was attempted or expected.
  • Why cleanup could not be confirmed, such as missing permissions, external CI retention, policy-managed retention, test crash before teardown, or unavailable audit access.
  • Residual exposure risk and who must follow up.
  • Any safe remediation command, ticket, or repository-owned cleanup process, with placeholders for private paths and identifiers.

Verification Expectations

  • Prefer repository-owned validation recipes when they exist; cite exact commands run and sanitized pass/fail results.
  • Do not treat search output, screenshots containing secrets, or raw logs as shareable security evidence.
  • If verification is skipped or partial, report the missing control, why it was not checked, and the residual risk.

Zod Evidence Limits

For selected Zod work, load zod-engineering. Retain only bounded issue codes and sanitized paths; never retain raw input, transformed values, full issues, custom messages, or reportInput output without explicit policy.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.