grafana-cloud-investigation
Skill137 starsChanged 10 days agoApache-2.0View on GitHub
Use the Grafana Cloud connector to investigate incidents with the customer's Grafana Cloud telemetry. Covers choosing tools, when to use Grafana Assistant, the Read, Query and Write access levels, confirming every write with the operator, keeping results small, and querying Prometheus, Loki and Tempo data. Use when an investigation needs metrics, logs, traces or profiles from Grafana Cloud, when checking Grafana dashboards, alert rules, incidents or on-call schedules, or when the customer asks a question about their Grafana Cloud stack.
In this repository72 other files it gives its agents.
- .claude/CLAUDE.mdCLAUDE.md
- llms.txtllms.txt
- agentcore-observability-setupSkill
- agentcore-ops-reviewSkill
- aiml-access-diagnosticsSkill
- aiml-gpu-training-cluster-investigationSkill
- analytics-opensearch-expertiseSkill
- aws-backup-coverage-reviewSkill
- aws-eks-healthdashboardSkill
- aws-eks-operations-reviewSkill
- aws-fsxn-operations-reviewSkill
- aws-health-eventsSkill
- aws-natgw-traffic-analysisSkill
- aws-routingSkill
- aws-vpc-dns-investigationSkill
- bedrock-adoption-readinessSkill
- bedrock-operation-reviewSkill
- bronto-dataset-discoverySkill
- bronto-error-investigationSkill
- bronto-log-searchSkill
- cloudtrail-cost-optimizationSkill
- config-cost-optimizationSkill
- coralogix-ai-centerSkill
- coralogix-alertsSkill
- coralogix-case-analyticsSkill
- coralogix-case-managementSkill
- coralogix-casesSkill
- coralogix-dashboardsSkill
- coralogix-dataprimeSkill
- coralogix-datasetsSkill
- coralogix-data-usageSkill
- coralogix-docsSkill
- coralogix-infrastructureSkill
- coralogix-logsSkill
- coralogix-metrics-querySkill
- coralogix-ollySkill
- coralogix-rumSkill
- coralogix-service-catalogSkill
- coralogix-single-caseSkill
- coralogix-spansSkill
- coralogix-viewsSkill
- crm-production-investigation-guidelinesSkill
- database-migration-service-expertiseSkill
- database-rds-devopsSkill
- devops-agent-cost-insightsSkill
- ecs-operation-reviewSkill
- eks-upgrade-readinessSkill
- enrich-with-aws-security-agentSkill
- eos-cost-analysisSkill
- firehose-operation-reviewSkill
- guardduty-cost-optimizationSkill
- honeycomb-create-boardSkill
- honeycomb-metrics-queriesSkill
- honeycomb-observability-fundamentalsSkill
- honeycomb-production-investigationSkill
- honeycomb-query-patternsSkill
- honeycomb-slos-and-triggersSkill
- honeycomb-verify-recent-traceSkill
- investigation-cost-guardrailSkill
- live-streaming-event-readiness-reviewSkill
- The first 60 shown.
The file
We split this skill into the rules it gives an agent
10 rules. About 0 are common, 10 are distinctive, and 0 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈10
Distinctive · estimate
This author's own choices. Worth a look.
0
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 22
Read the server's instructions and each tool's description.
- Distinctive: line 26
If a tool you expect isn't available, the connection may not have been granted that access level, or the feature may not be enabled on the …
- Distinctive: line 31
Check firing alerts, open incidents and recent annotations (deploys, config changes) in the incident's time window.
- Distinctive: line 39
Use Grafana Assistant only when an operator asks for it, or when you recommend it and the operator approves.
- Distinctive: line 45
Prefer the tools that return a dashboard's summary or a single property over the one that returns its full JSON.
- Distinctive: line 47
Always set a time range, starting from the incident window, and widen it only if needed.
- Distinctive: line 55
Only make a write when an operator explicitly asked for it.
- Distinctive: line 56
Before each write, show the operator exactly what you'll do: the tool, the target, and the full change, query or question.
- Distinctive: line 57
Ask for confirmation immediately before the call, and make the call only after the operator confirms.
- Distinctive: line 58
If the operator declines, or DevOps Agent's approval is denied, don't retry the write and don't try another tool or route to the same …
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Grafana Cloud investigations
The Grafana Cloud connector reaches the customer's Grafana Cloud stack through Grafana's hosted MCP server. It acts as the person who connected it, so it can see and do only what their Grafana roles allow.
Choosing tools
The server's tools change as Grafana adds capabilities, so this skill doesn't list them. Rely on the server instead:
- Read the server's instructions and each tool's description. They're kept current with the server and say what each tool does and when to use it.
- Pick tools by what you need. There are tools for dashboards, data sources, Prometheus, Loki, Tempo and Pyroscope queries, SQL data sources, alerting, incidents, on-call, annotations, Grafana Assistant investigations, deep links and panel rendering.
- When no dedicated tool covers a task, the server describes fallbacks: a Grafana CLI tool and a raw Grafana API tool. Use them only to read: GET requests with the API tool, and only commands that read with the CLI tool. Never use them to create, change or delete anything.
- The SQL query tools run a query exactly as written. Only run
SELECTqueries; treat any other statement as a write. - If a tool you expect isn't available, the connection may not have been granted that access level, or the feature may not be enabled on the stack. Say so in your findings rather than guessing.
A typical investigation
- Find the relevant data sources and dashboards for the affected service before querying anything.
- Check firing alerts, open incidents and recent annotations (deploys, config changes) in the incident's time window.
- Query metrics for the service's error rate, latency and saturation around the incident start, then narrow to the components that moved.
- Query logs for the same components and window, and pull traces for slow or failing requests.
- Include deep links to the dashboards, Explore queries or traces that support each finding, so an operator can check them.
Grafana Assistant
- Investigate with the read tools first. Grafana Assistant can plan its own investigation across metrics, logs and traces, but asking it a question or starting an Assistant investigation is a write: it needs a connection with Write access and counts toward the stack's Grafana Assistant usage.
- Use Grafana Assistant only when an operator asks for it, or when you recommend it and the operator approves. Follow the rules for writes below, showing the exact question you'll send.
- On a connection without Write access, the Assistant tools aren't available. Use the read tools and say in your findings that Assistant wasn't used.
- Reading existing Assistant investigations, their reports and their evidence is a read, and is fine at any time.
Keeping results small
- Prefer the tools that return a dashboard's summary or a single property over the one that returns its full JSON.
- Discover metric and label names before writing PromQL or LogQL, rather than guessing.
- Always set a time range, starting from the incident window, and widen it only if needed.
- In Loki, use label matchers to select streams before filtering on line content.
- Aggregate before returning series: a
sum by (...)ortopkis usually more useful than hundreds of raw series.
Rules for writes
A write is any call that creates, changes or deletes something in Grafana (dashboards, alert rules, silences, incidents, annotations, data sources), asks Grafana Assistant a question, starts an Assistant investigation, or runs SQL other than SELECT.
- Only make a write when an operator explicitly asked for it. During triage and root-cause analysis, propose changes as recommended actions instead.
- Before each write, show the operator exactly what you'll do: the tool, the target, and the full change, query or question.
- Ask for confirmation immediately before the call, and make the call only after the operator confirms.
- If the operator declines, or DevOps Agent's approval is denied, don't retry the write and don't try another tool or route to the same effect. Report that it wasn't made.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

