agentleFS
OpenCovenOpenCoven/coven/skills/skill-scanner/SKILL.md

skill-scanner

Skill75 starsChanged 4 months agoMITView on GitHub

Scan, audit, validate, package, or pre-submit AgentSkills using the local BunsDev codeql-sdk/clawhub-audit scanner and OpenClaw skill validation. Use when a user asks to run codeql-sdk, scan a skill before submitting, security-audit a SKILL.md package, produce JSON/SARIF reports, or ensure a skill is ready for Cody/ClawHub handoff.

  • Installs packages

8 other projects use a version of this.

Adopted by

Most recently taken up by

Used with

Projects with it also use skill-creator.

Other files people use alongside this one.

Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
  • SentrySkill

    skill-creator

    Create new agent skills following the Agent Skills specification. Use when asked to "create a skill", "add a new skill", "write a skill", "make a skill", "build a skill", or scaffold a new skill with SKILL.md. Guides through requirements, writing, registration, and verification.

    Also in 3 projects that use this

The file

We split this skill into the rules it gives an agent

11 rules. 0 are common, 6 are distinctive, and 5 are very specific to this project.

  • 0

    Common

    Most of the 7 edited versions we read keep these.

  • 6

    Distinctive

    This author's own choices. Worth a look.

  • 5

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Use this skill for pre-submit scanning and validation of AgentSkills.

    line 8
  2. Distinctive:

    Do not call a skill ready until both gates have been attempted:

    line 12
  3. Very specific:

    If CodeQL CLI is missing, report that as a blocker and give the exact install/rerun command.

    line 17
  4. Very specific:

    Read references/codeql-sdk.md for CLI details, report formats, and troubleshooting.

    line 26
  5. Distinctive:

    Run CodeQL SDK scan:

    line 53
  6. Distinctive:

    If the JSON scan passes, optionally generate SARIF for CI/ClawHub:

    line 62
  7. Very specific:

    If CodeQL errors with CodeQL did not detect any code, the SDK scan was attempted but not applicable to that skill's contents.

    line 86
  8. Very specific:

    If scan fails with CodeQL CLI not found, say exactly that the SDK is installed but its runtime dependency is missing.

    line 90
  9. Very specific:

    Do not commit .scan-reports/ reports unless the user explicitly asks.

    line 102
  10. Distinctive:

    Do not print secrets found in reports.

    line 103
  11. Distinctive:

    When handing a scanned skill to Cody or another agent, include:

    line 107

“Common” is measured: kept by at least 6 in 10 of the 7 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Skill Scanner

Use this skill for pre-submit scanning and validation of AgentSkills.

Prime directive

Do not call a skill ready until both gates have been attempted:

  1. Skill structure gate — openclaw skills check and/or package_skill.py validation.
  2. Security scan gate — codeql-sdk / clawhub-audit scan.

If CodeQL CLI is missing, report that as a blocker and give the exact install/rerun command. If CodeQL runs but reports no analyzable source code, mark the security scan as not applicable, not passed. Do not silently replace the scan with weaker checks.

Default local paths

  • SDK repo: /Users/buns/Documents/GitHub/BunsDev/codeql-sdk
  • SDK CLI source: /Users/buns/Documents/GitHub/BunsDev/codeql-sdk/dist/cli.js
  • Skill creator package validator: ~/.nvm/versions/node/v24.13.0/lib/node_modules/openclaw/skills/skill-creator/scripts/package_skill.py
  • Workspace skills root: /Users/buns/.openclaw/workspace/skills

Read references/codeql-sdk.md for CLI details, report formats, and troubleshooting.

Standard scan workflow

Given a skill directory:

SKILL_DIR=/absolute/path/to/skill
REPORT_DIR="$(dirname "$SKILL_DIR")/.scan-reports/$(basename "$SKILL_DIR")"
mkdir -p "$REPORT_DIR"
  1. Preflight:
test -f "$SKILL_DIR/SKILL.md"
node /Users/buns/Documents/GitHub/BunsDev/codeql-sdk/dist/cli.js version
command -v codeql || test -x "$CODEQL_PATH"
  1. Validate structure:
openclaw skills check
python3 ~/.nvm/versions/node/v24.13.0/lib/node_modules/openclaw/skills/skill-creator/scripts/package_skill.py "$SKILL_DIR" /tmp/skill-packages
  1. Run CodeQL SDK scan:
node /Users/buns/Documents/GitHub/BunsDev/codeql-sdk/dist/cli.js audit "$SKILL_DIR" \
  --format json \
  --output "$REPORT_DIR/codeql-sdk-results.json" \
  --fail-on-high
  1. If the JSON scan passes, optionally generate SARIF for CI/ClawHub:
node /Users/buns/Documents/GitHub/BunsDev/codeql-sdk/dist/cli.js audit "$SKILL_DIR" \
  --format sarif \
  --output "$REPORT_DIR/codeql-sdk-results.sarif"

Expected result summary

Return a compact status block:

Skill: <name>
Structure validation: passed|failed
Package validator: passed|failed
CodeQL SDK scan: passed|failed|blocked|not applicable
Report: <path>
Ready to submit: yes|no
Notes: <critical findings or blocker>

No analyzable source code

If CodeQL errors with CodeQL did not detect any code, the SDK scan was attempted but not applicable to that skill's contents. This often happens for markdown-only skills. Report: CodeQL SDK scan: not applicable (no analyzable source code detected). Do not call it a pass.

CodeQL CLI missing blocker

If scan fails with CodeQL CLI not found, say exactly that the SDK is installed but its runtime dependency is missing. On this Mac, the expected install is:

brew install --cask codeql

Then rerun the audit command. Installing CodeQL is a machine-level state change; ask before doing it unless the user explicitly approved install/update actions.

Report handling

  • JSON reports are useful for agent parsing and memory.
  • SARIF reports are useful for CI, GitHub, and security tooling.
  • Do not commit .scan-reports/ reports unless the user explicitly asks.
  • Do not print secrets found in reports. Summarize rule IDs, severity, file paths, and line numbers only.

Handoff guidance

When handing a scanned skill to Cody or another agent, include:

  • skill directory path
  • packaged .skill path if available
  • scan report path
  • whether CodeQL SDK passed or was blocked
  • any critical/high finding summaries
  • exact rerun command

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.