agentleFS
aws-solutionsaws-solutions/konductor/skills/design-quality-check/SKILL.md

design-quality-check

Skill11 starsChanged 50 days agoApache-2.0View on GitHub

Scores a design document for writing quality, structural completeness, and KISS/YAGNI compliance. Detects slop (filler phrases, hedge words, unsupported claims, passive-voice overuse, circular reasoning) and flags complexity violations. Trigger phrases: "check doc quality", "slop detection", "quality gate before design review", "is this doc ready", "check for filler language".

The file

We split this skill into the rules it gives an agent

4 rules. About 0 are common, 4 are distinctive, and 0 are very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈4

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 0

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Use this skill when:

    line 12
  2. Distinctive:

    Do not flag technical hedging that is accurate (e.g., "Lambda cold starts typically add 100–500ms" is not a hedge — it is a range).

    line 79
  3. Distinctive:

    Do not flag passive voice in formal definitions or standards references.

    line 80
  4. Distinctive:

    Do not penalize brevity — a short, complete doc scores higher than a verbose, incomplete one.

    line 81

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Design Quality Check

When to Use

Use this skill when:

  • Running the final quality gate before design review submission
  • Invoked as the first quality gate step in design review workflows
  • Engineer asks to check doc quality, detect filler language, or verify KISS/YAGNI compliance

Steps

  1. Load document — Accept a markdown file path or inline content. Report section count and approximate word count.
  2. Structural completeness check — Verify the document contains all required outside-in sections:

    • Problem / Background
    • Requirements
    • Solution Overview
    • How It Works (with at least one diagram reference)
    • Implementation Details / Plan
    • Architecture Decision Records (at least one ADR if decisions were made)

    Flag each missing required section as an issue of type missing_section.

  3. Slop detection — Scan every paragraph for the following issue types:

    TypeExamplesSeverity
    filler_phrases"it is worth noting", "needless to say", "as mentioned above", "in order to", "it should be noted that"MINOR
    hedge_words"might", "could potentially", "may or may not", "somewhat", "fairly" (when used to avoid commitment)MINOR
    unsupported_claimsPerformance/latency/cost assertions with no evidence URL or measurementIMPORTANT
    passive_voice_overuse>30% passive constructions in a sectionMINOR
    circular_reasoningJustification restates the claim without adding evidence (e.g., "we chose X because X is the best choice")IMPORTANT
    yagni_violationFeatures, abstractions, or extensibility points not required by stated requirementsIMPORTANT
    missing_sectionRequired section absentIMPORTANT
  4. Complexity scoring — For each decision or design choice, check:

    • Is the simplest option chosen, or is complexity justified by a stated requirement?
    • Are there abstractions with no current use case?

    Flag unjustified complexity as yagni_violation.

  5. Score — Compute overall score 1–5:
    • 5: No issues
    • 4: Only MINOR issues (≤3)
    • 3: MINOR issues (>3) or IMPORTANT issues (1–2)
    • 2: IMPORTANT issues (3+), no missing required sections
    • 1: IMPORTANT issues (3+) AND one or more missing sections (structural gaps)
  6. Output — Return:

    Quality Score: N/5
    Issues: {N} IMPORTANT, {N} MINOR
    [For each issue: location (section + approximate line), type, suggestion]

Rubric

ScoreMeaningGate
5No issuesReview-ready
4Only MINOR issues (3 or fewer)Review-ready with notes
3More than 3 MINOR issues, or 1–2 IMPORTANT issuesAdvance with revision notes
23 or more IMPORTANT issues, no missing required sectionsSignificant revision needed
13 or more IMPORTANT issues plus one or more missing sectionsRewrite required

Quality gate: Score ≥ 3 required to advance to adversarial review. Score < 3 blocks advancement and requires revision.

Pitfalls

  • Do not flag technical hedging that is accurate (e.g., "Lambda cold starts typically add 100–500ms" is not a hedge — it is a range).
  • Do not flag passive voice in formal definitions or standards references.
  • Do not penalize brevity — a short, complete doc scores higher than a verbose, incomplete one.
  • unsupported_claims applies only to quantitative assertions (latency, cost, throughput). Qualitative design rationale does not require evidence URLs.

Verification

After scoring, confirm:

  • Every IMPORTANT issue has a concrete suggestion for resolution
  • Score reflects the worst issue type present (one IMPORTANT issue cannot yield score 5)
  • Missing required sections are flagged even if the document is otherwise well-written

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.