agent-evaluation
Skill2 starsChanged 3 months agoNo licenceView on GitHub
Use this when you need to EVALUATE OR IMPROVE or OPTIMIZE an existing LLM agent's output quality - including improving tool selection accuracy, answer quality, reducing costs, or fixing issues where the agent gives wrong/incomplete responses. Evaluates agents systematically using MLflow evaluation with datasets, scorers, and tracing. IMPORTANT - Always also load the instrumenting-with-mlflow-tracing skill before starting any work. Covers end-to-end evaluation workflow or individual components (tracing setup, dataset creation, scorer definition, evaluation execution).
- Reads credentials
We split this skill into the rules it gives an agent
34 rules. 0 are common, 21 are distinctive, and 13 are very specific to this project.
0
Common
Most of the 17 edited versions we read keep these.
21
Distinctive
This author's own choices. Worth a look.
13
Very specific
Tied to their project's names, files or tools. Probably skip.
No licence file, so all rights are reserved — read it at the source. We count its rules but don't quote them. Read them on GitHub.
“Common” is measured: kept by at least 6 in 10 of the 17 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Other versions21 projects use a version of this.
Word for word · 0
None found.
Edited · 1
- sshtomar/claude-skills★ 082% same
Wrote their own version · 20
- bojieli/ai-agent-book-projects★ 53ksame name
- bojieli/ai-agent-book★ 53ksame name
- microsoft/Building-AI-Agents-From-Zero-To-Production★ 194same name
- alebgl77/claude-inc★ 21same name
- fmind/dot★ 12same name
- fmind/dotfiles★ 12same name
- dzianisv/opencode-plugins★ 11same name
- xfstudio/skills★ 9same name
- nek1987/auto-agent-harness★ 4same name
- ai4brands-design/claude-skills★ 2same name
10 more not listed
How matches are found. Word for word: the exact same text. Edited: shares passages with this file (“99% same” means 99% of its five-word phrases also appear here; 10% or more counts). Their own version: similar meaning, or, weakest, the same name. We can’t tell which project had it first. Projects are counted among the 200 most-starred candidates, and mentions are links to the repository we found, up to 50 per site, so both counts are a floor.
Used alongsideProjects with it also use quality-assurance, tool-design and 3 more.
Other files people use alongside this one.
Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
jasonkneenSkillquality-assurance
Comprehensive testing and validation strategies for spec-driven development. Learn phase-specific validation techniques, quality gates, and testing approaches to ensure high-quality implementation.
Also in 3 projects that use this
mjunaidcaSkilltool-design
Design tools that agents can use effectively. Use when creating new tools for agents, debugging tool-related failures, or optimizing existing tool sets.
Also in 3 projects that use this
- mjunaidcaSkill
kubernetes
Production-grade Kubernetes manifests and debugging for containerized applications. This skill should be used when users ask to deploy to Kubernetes, create K8s manifests, containerize for K8s, set up Deployments/Services/Jobs/StatefulSets/CronJobs, create namespaces with resource quotas, set up multi-team isolation, configure ResourceQuota/ LimitRange, secure with RBAC (ServiceAccount, Role, RoleBinding), configure init containers (model download, db wait, migrations), set up sidecars (logging, metrics), or debug pods (CrashLoopBackOff, logs, exec, describe, events). Auto-detects from Dockerfile/code, generates hardened manifests with educational comments. CKAD-aligned.
Also in 3 projects that use this
abdullah1854Skillgithub-actions
Also in 3 projects that use this
OpenAISkillobservability
Vercel Observability expert guidance — Drains (logs, traces, speed insights, web analytics), Web Analytics, Speed Insights, runtime logs, custom events, OpenTelemetry integration, and monitoring dashboards. Use when instrumenting, debugging, or optimizing application performance and user experience on Vercel.
Also in 3 projects that use this
In this repository35 other files it gives its agents.
- analyzing-mlflow-sessionSkill
- analyzing-mlflow-traceSkill
- databricks-agent-bricksSkill
- databricks-aibi-dashboardsSkill
- databricks-ai-functionsSkill
- databricks-apps-pythonSkill
- databricks-appsSkill
- databricks-bundlesSkill
- databricks-configSkill
- databricks-dbsqlSkill
- databricks-docsSkill
- databricks-genieSkill
- databricks-icebergSkill
- databricks-jobsSkill
- databricks-lakebase-autoscaleSkill
- databricks-lakebase-provisionedSkill
- databricks-lakebaseSkill
- databricks-metric-viewsSkill
- databricks-mlflow-evaluationSkill
- databricks-model-servingSkill
- databricks-python-sdkSkill
- databricks-coreSkill
- databricks-spark-declarative-pipelinesSkill
- databricks-spark-structured-streamingSkill
- databricks-synthetic-data-genSkill
- databricks-unity-catalogSkill
- databricks-unstructured-pdf-generationSkill
- databricks-vector-searchSkill
- databricks-zerobus-ingestSkill
- instrumenting-with-mlflow-tracingSkill
- mlflow-onboardingSkill
- querying-mlflow-metricsSkill
- retrieving-mlflow-tracesSkill
- searching-mlflow-docsSkill
- spark-python-data-sourceSkill
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
Reviews can't be read right now.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.