agentleFS
fatih-developerfatih-developer/fth-skills/skills/output-critic/SKILL.md

output-critic

Skill7 starsChanged 43 days agoMITView on GitHub

Evaluate every produced output (code, report, plan, data, API response) against type-specific quality criteria, score 1-10, make accept/reject decisions, and provide actionable improvement suggestions. Triggers on 'evaluate', 'check', 'review', 'quality control', 'is this good enough', 'score it', or before passing output to the next step in an agentic workflow.

The file

We split this skill into the rules it gives an agent

1 rule. About 0 are common, 1 is distinctive, and 0 are very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈1

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 0

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    When improved output is resubmitted:

    line 112

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Output Critic Protocol

Evaluate the output by type, score each criterion, make an accept/reject decision, and suggest concrete improvements. Goal: prevent weak output from reaching the next step.


Workflow

1. Detect output type
2. Apply type-specific criteria
3. Score each criterion
4. Calculate overall score
5. Make accept / conditional / reject decision
6. Suggest improvements

Acceptance Threshold

Overall ScoreDecisionAction
8-10ACCEPTProceed
6-7CONDITIONALApply minor fixes, then proceed
0-5REJECTApply improvements, re-evaluate

Type-Specific Criteria

Code

CriterionWeightQuestion
Correctness30%Produces expected output? Handles edge cases?
Readability20%Meaningful names? Clean indentation?
Security20%SQL injection? Hardcoded secrets? Unsafe input?
Performance15%Unnecessary loops? N+1 queries? Memory leaks?
Testability15%Functions independently testable?

Report / Written Content

CriterionWeightQuestion
Accuracy30%Claims supported? Misleading statements?
Coverage25%All requested topics addressed? Missing sections?
Clarity20%Target audience can understand? Jargon explained?
Structure15%Logical flow? Consistent headings?
Actionability10%Reader knows what to do next?

Plan / Task List

CriterionWeightQuestion
Completeness30%All necessary steps present? Critical step missing?
Atomicity25%Each step does one thing? Overly broad steps?
Dependency accuracy20%Order makes sense? Circular dependencies?
Verifiability15%Each step has clear "done" criteria?
Realism10%Steps are achievable? Overly optimistic estimates?

Data / Table

CriterionWeightQuestion
Accuracy35%Numbers consistent? Calculations correct?
Completeness25%Missing rows/columns? Nulls explained?
Format consistency20%Units, date formats, currency consistent?
Readability20%Meaningful headers? Proper sorting?

Output Format

OUTPUT CRITIC
Type     : [output type]
Decision : ACCEPT / CONDITIONAL / REJECT
Score    : [X/10]

## Criterion Scores

| Criterion | Score | Note |
|-----------|-------|------|
| [Criterion 1] | X/10 | [short note] |
| [Criterion 2] | X/10 | [short note] |
| **Overall** | **X/10** | |

## Strengths
- [What was done well — specific]

## Weaknesses
- [What is missing / wrong — specific]

## Improvement Suggestions
1. [Concrete action — what to do, where]
2. [Concrete action]

## Next Step
[Accept -> proceed | Conditional -> fix X | Reject -> apply suggestions, resubmit]

Re-Evaluation

When improved output is resubmitted:

RE-EVALUATION
Previous score: X/10
New score     : Y/10
Change        : +N points
Improved      : [which criteria]
Still open    : [remaining issues if any]

When to Skip

  • User said "quick and dirty, doesn't need to be perfect"
  • Prototype / draft stage (user explicitly stated)
  • Single-line simple output

Guardrails

  • Never accept security issues — hardcoded secrets = automatic REJECT regardless of other scores.
  • Be specific in suggestions — "improve code" is useless; "move API key to env var at line 12" is actionable.
  • Cross-skill: works with task-decomposer (validates plan quality), output-critic is the quality gate before task completion.

References

  • references/EXAMPLES.md — scored critiques of code, reports, plans, and data outputs. Read it when the expected output format or level of detail is unclear.

🔗 Next Steps & Handoffs

<!-- BEGIN GENERATED: handoffs (generated from the ecosystem workflow map by build_ecosystems.py — do not edit by hand) -->

Ecosystem: @ecosystem-orchestration — Agent Orchestration.

Workflows:

  • Complex Task Execution Flow (orch-complex-task, step 5 of 6): next → @agent-reviewer (optional).
  • Decision Quality Flow (reason-decision, step 5 of 5, via @ecosystem-reasoning): last step → once it passes, complete the workflow and report the outcome.

Handoff contract: pass results to the next skill through an inline Handoff block in your reply with the fields skill, workflow, created_at, inputs, summary, and next (the handoff contract of @ecosystem-orchestration). If a next skill is not installed, continue with its step from the ecosystem map, or install it with npx skills add fatih-developer/fth-skills --skill <name> after the user agrees.

<!-- END GENERATED: handoffs -->

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.