agentleFS
Red-empty-potatoRed-empty-potato/ai-agent-skills/skills/llm-evaluation/SKILL.md

llm-evaluation

Skill0 starsChanged 3 months agoMITView on GitHub

Evaluate LLM outputs systematically with a small rubric (correctness, style, safety). 用评分标准系统评估 LLM 输出质量。

19 other projects use a version of this.

Adopted by

Most recently taken up by

Used with

Projects with it also use code-review.

Other files people use alongside this one.

Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
  • GoogleSkill

    code-review

    Adversarial systems, concurrency, memory-model, and architecture code review protocol. Use this skill whenever asked to review code, PRs, diffs, or branches in Filament.

    Also in 3 projects that use this

The file

Files
SKILL.md

LLM Evaluation | LLM 输出评估

Score LLM outputs against a small rubric so「变好了还是变差了」是数字,而不是感觉。

让模型输出的好坏可量化、可比较。

When to use | 适用场景

  • 用户在对比两个 prompt / 两个模型 / 前后改动
  • 想给输出质量立个可复现的标准

Workflow | 工作流程

  1. 定义任务 + 评分维度(正确性 / 完整性 / 风格 / 安全,每个 1–5 分)。
  2. 准备 5–10 个代表性测试输入(含 1–2 个难例)。
  3. 让评估者对每个输入按维度打分(人或模型皆可,注明是谁评的)。
  4. 汇总平均分,输出对比表。
  5. 结论:哪个方案赢、赢在哪一维、下一步改哪里。

Tips | 提示

  • 评分标准先写死,再打分,别打分时改标准。
  • 有争议的案例单独列出,比平均分更有信息量。

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.