agentleFS
lucastosettolucastosetto/dev-skills/skills/observe/SKILL.md

observe

Skill0 starsChanged 25 days agoMITView on GitHub

Check how a feature, endpoint, job or deploy is behaving in an environment: logs, metrics (rate/errors/latency), traces, error tracker, product analytics and experiments, compared to a baseline, ending in a health report. Use on "monitor this feature", "how is X doing in prod", "anything wrong after the deploy?", "check errors for Y", "experiment results", "/observe".

10 other projects use a version of this.

Adopted by

Most recently taken up by

Used with

Projects with it also use design and ship.

Other files people use alongside this one.

Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
  • Microsoft AzureSkill

    design

    Design rules and conventions for the API Center Portal. Use when editing detail pages, card components, badges, layout, navigation, sidebars, or headers. Covers badge styling, metadata placement, page navigation patterns, and layout alignment.

    Also in 3 projects that use this

  • AWSSkill

    ship

    Finalize dev work on an issue branch — update docs, push, and open a PR.

    Also in 3 projects that use this

The file

We split this skill into the rules it gives an agent

4 rules. 0 are common, 1 is distinctive, and 3 are very specific to this project.

  • 0

    Common

    Most of the 9 edited versions we read keep these.

  • 1

    Distinctive

    This author's own choices. Worth a look.

  • 3

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Very specific:

    Follow ../../shared/policy.md.

    line 13
  2. Distinctive:

    Environment: default prod; match the profile's per-environment tools.

    line 19
  3. Very specific:

    Run the collection inside one Agent call, model: haiku (policy "Delegating big reads"), returning per signal: numbers for target and …

    line 31
  4. Very specific:

    When called by deploy, return the verdict and findings only.

    line 51

“Common” is measured: kept by at least 6 in 10 of the 9 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Observe

Follow ../../shared/policy.md. Run dev-skills:project-profile if not loaded this session. Reads only. Tool notes: ../../shared/references/observability.md.

1. Frame

  • Target: turn the feature/ticket into concrete signals: routes, controllers, job classes, event names, flag names, log messages (read the code to find them).
  • Environment: default prod; match the profile's per-environment tools.
  • Window: given, or since the feature's deploy (find it: merge time, deploy annotation, release list), or the last 24h. Baseline: the same window a week earlier, or the window before the deploy.

2. Collect

For target and baseline:

  • Traffic, error rate, p95/p99 latency for the routes/jobs.
  • Error tracker: new issues and their counts, first-seen vs deploy time.
  • Logs: error/warning patterns for the target, volume change.
  • Traces: slowest and failing spans for the target.
  • Jobs/queues: failures, retries, queue depth.
  • Analytics/experiments (if connected): event counts, funnel steps, variant metrics with sample sizes. Run the collection inside one Agent call, model: haiku (policy "Delegating big reads"), returning per signal: numbers for target and baseline, verbatim decisive lines, and the queries and labels used. A source not connected is listed under Gaps with the exact query the user could run.

3. Judge

Separate real change from noise: compare with baseline, check whether a change is only this target or system-wide, and line up with deploys and incidents in the window.

Output

<target> — <env> — <window> vs <baseline>
Verdict: healthy | degraded | broken | not enough data
- Traffic: <n> (<±%>)
- Errors: <rate> (<±%>); new issues: <title — count — first seen>
- Latency p95: <ms> (<±%>)
- Analytics: <metric — change>
Findings: <one line each with numbers and a link>
Next: <nothing | run dev-skills:investigate on <finding> | rollback candidate>
Gaps: <missing source — query to close it>

When called by deploy, return the verdict and findings only.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.