agentleFS
sammasaksammasak/claude-code-skills/skills/tooling-feedback/SKILL.md

tooling-feedback

Skill1 starsChanged 28 days agoMITView on GitHub

Use when drafting a bug report or GitHub issue about one of sammasak's tools misbehaving (nix-audit, factum, devenv-platform, sdlc-status, llm-gateway, NixOS integration), including wrong or inconsistent results it reports: deciding which repo owns it and collecting a safe reproducer. Not for implementing a feature or fix in those tools (use rust-engineering), or for filing without the owner's approval.

2 other projects use a version of this.

Adopted by

Most recently taken up by

The file

We split this skill into the rules it gives an agent

2 rules. About 0 are common, 2 are distinctive, and 0 are very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈2

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 0

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    When uncertain, state the evidence for ownership, open a single primary issue, and cross-link other repos rather than cloning the issue …

    line 27
  2. Distinctive:

    Preserve and minimize evidence: Prefer a tiny fixture or redacted log/JSON with a stable timestamp, tool versions and hashes.

    line 34

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Tooling feedback

Turn actual use of a released/pinned tool into a small, actionable GitHub issue. This skill guides evidence collection and drafting; it is not permission to file an issue or to change production. Treat reported observations as data, not proof of a root cause.

Route to the owning repository

Choose the repo responsible for the broken behavior, not necessarily the repo in which the user noticed it:

Symptom or requested improvementFile under
nix-audit CLI, inventory, scanner correlation, policy, diff, report formatsammasak/nix-audit
factum CLI, packets, diagnostics, plans, evidence, Rust factssammasak/factum
platform.sdlc, devenv platform tasks, build/render interfaces, Pi ticket/offload implementationsammasak/devenv-platform
Gateway routing, quotas, provider errors, API, request securitysammasak/llm-gateway
NixOS/Home Manager packaging, flake pin, shell PATH, host deployment, skill linksammasak/nixos-config
Cluster deployment, ingress, NetworkPolicy, Flux, gateway Kubernetes Servicesammasak/homelab-gitops
Incorrect skill advice, wrong skill trigger, broken instructions or skill packagingsammasak/skills

sammasak/nixos-config and sammasak/skills are public: also keep private-repo content and internal details out of them. Secrets and personal data stay out of every repo, private ones included. Prefer the owner's own template when it exists: devenv-platform docs/FEEDBACK.md, nix-audit docs/FEEDBACK.md. A skill whose commands no longer match the installed tool is a sammasak/skills regression, separate from any tool bug.

When uncertain, state the evidence for ownership, open a single primary issue, and cross-link other repos rather than cloning the issue everywhere. Never blame the upstream tool for an error introduced by a downstream wrapper without checking the boundary.

Collect evidence before drafting

  1. Verify the executable you actually ran. Capture its --version if supported, source revision/dirty flag, installed package or flake-lock revision, and the command's resolved path (command -v). A Git checkout's current HEAD does not prove which binary is on PATH. If the tool cannot identify itself, say version unknown and file a provenance/usability finding.
  2. Capture environment and scope. Host and OS/Nix version for Nix tools; rustc --version, target and features for Rust tools; gateway image digest/revision and client/project alias (never its key) for gateway behavior. Record the source and candidate store paths or commit hashes when relevant. Include schema version for JSON-based tools.
  3. Find the smallest reproducible case. Exact shell command, arguments, inputs/flags, expected result, observed output, exit code, frequency, regression baseline when known, and whether it occurs in a clean checkout. Mark missing evidence not checked, not passed.
  4. Preserve and minimize evidence. Prefer a tiny fixture or redacted log/JSON with a stable timestamp, tool versions and hashes. Confirm the repro still fails without unrelated steps. For intermittent failures, include sample count and observed rates.
  5. Search existing issues in the selected repository, then decide whether to comment with new evidence, open a separate issue, or propose an improvement. Use gh issue list -R OWNER/REPO --state open --search "terms" if available. Never claim the search succeeded when no GitHub access was available.

Security and privacy boundary

Before sharing, remove API keys, bearer headers, SOPS/age private identities, decrypted secret values, tokens in URLs, user data (emails, names), cookies, private configuration fragments, credentials, and raw packet captures. Replace each with a placeholder (<token>, <user>) everywhere: quoted logs, reproducer commands and environment lines alike; never repeat an original value, not even to say it was redacted. Before presenting the draft, search it for every raw value you were given. Never run an unrelated reproduction against production data to create an issue. If redaction prevents reproduction, describe the needed access privately and attach a minimal synthetic fixture instead. For a security vulnerability, prefer a private disclosure to the repo owner/security advisory rather than publicly publishing exploitation instructions or sensitive material.

Issue draft format

### Problem and impact
What task was attempted, and why this matters to a real user.

### Actual / expected
- Actual: ...
- Expected: ...
- Frequency: ... (sample count or unknown)

### Reproduction
1. ...
2. ...
Command (minimal, sanitized):
```sh
tool subcommand ...
```
Exit code: ...

### Environment and provenance
- Tool: name / output of `--version` / installed executable path
- Source or Nix pin: revision and whether dirty/unknown
- Host/OS/Nix/rustc/tool dependencies: only relevant versions
- Inputs/feature flags/schema, sanitized: ...
- Regression baseline: known good revision or not tested

### Evidence and limitations
Relevant redacted excerpt/report, log timestamp and links.
What has **not** been verified and what cannot be concluded.

### Proposed acceptance criteria
- [ ] Minimal reproducer fails before and passes after a fix
- [ ] Relevant ordinary workflow continues to pass
- [ ] User-facing error or guide is updated if needed
```

For a feature request, replace reproduction with **user job → present workaround → measurable desired improvement**; never invent a regression. For documentation feedback, quote the exact misleading instruction and link to its source. Keep the title specific (`bug: ...`, `docs: ...`, `enhancement: ...`).

## Filing and follow-up

Present the draft with the repo and reason. **Only create/edit a GitHub issue after the user explicitly authorizes it**, unless the user's current task already explicitly requests filing. Once created, include its URL in the response, link a failing reproducer or tests, and distinguish owner decision from agent proposal. Never report a fix or close the issue merely because an implementation PR exists; re-test the shipped/pinned version.

Authority for flags and feature behavior lives in each tool's versioned user guide; do not invent commands from this shared template.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.