benchmark-research
Skill4 starsChanged 29 days agoMITView on GitHub
[METHODOLOGY] Industry benchmark research — reverse-engineer how the fastest-growing companies in a given industry actually scaled (source harvest → company synthesis → cross-company meta-synthesis → private application layer). Evidence-disciplined, primary-source-first. Standalone capability — not wired into the agency cascade; has its own entry-point trigger.
In this repository48 other files it gives its agents.
- skills/dev-methodology/references/agents.mdAGENTS.md
- skills/skill-authoring/references/agents.mdAGENTS.md
- acceptance-protocolSkill
- agency-intakeSkill
- ai-visibility-methodologySkill
- banner-design-guideSkill
- brand-methodologySkill
- code-reviewingSkill
- code-writingSkill
- codex-bridgeSkill
- deploy-pipelineSkill
- design-assets-guideSkill
- design-system-methodologySkill
- design-task-decompositionSkill
- dev-methodologySkill
- docs-pipelineSkill
- documentation-writingSkill
- engagement-contractSkill
- engagement-protocolSkill
- feature-researchSkill
- human-voiceSkill
- infrastructure-setupSkill
- marketing-task-decompositionSkill
- post-deploy-qaSkill
- pre-deploy-qaSkill
- presentation-designSkill
- project-planningSkill
- prompt-engineeringSkill
- security-auditingSkill
- semantic-drift-methodologySkill
- seo-auditingSkill
- skill-authoringSkill
- skill-test-designSkill
- skill-testingSkill
- system-optimization-protocolSkill
- task-decompositionSkill
- tech-spec-planningSkill
- testing-methodologySkill
- ui-styling-guideSkill
- ui-ux-methodologySkill
- user-spec-planningSkill
- validation-pipelineSkill
- yandex-analytics-methodologySkill
- yandex-direct-guideSkill
- yandex-metrika-guideSkill
- yandex-search-guideSkill
- yandex-webmaster-guideSkill
- yandex-wordstat-guideSkill
The file
Show its rules and text
We split this skill into the rules it gives an agent
15 rules. About 0 are common, 14 are distinctive, and 1 is very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈14
Distinctive · estimate
This author's own choices. Worth a look.
1
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 33
When the trigger phrase fires, run a short intake before any research:
- Very specific: line 108
If a claim matters, label it.
- Distinctive: line 114
Prefer primary / operator sources.
- Distinctive: line 127
Avoid overweighting: recycled funding news · SEO summaries · unsourced listicles · vague market maps · press with no operator detail.
- Distinctive: line 150
Do not include a company just because it is famous.
- Distinctive: line 234
After enough company memos exist (recommended: ≥6), create:
- Distinctive: line 290
Do not create a new archetype for every one-off exception.
- Distinctive: line 310
ONLY after company synthesis and meta-synthesis are complete.
- Distinctive: line 348
Do archetypes group mechanisms, not vibes?
- Distinctive: line 365
Only use funding news if it includes original metrics, customer facts, or operator quotes.
- Distinctive: line 367
Unlabeled inference: If inferred, say it is inference.
- Distinctive: line 381
Not updating cross-synthesis after new company research: Every strong new memo should trigger a review of laws, matrix, archetypes, …
- Distinctive: line 403
Write one memo per company using the standard structure.
- Distinctive: line 406
Write a 5-page application memo.
- Distinctive: line 413
Use as the system / task instruction for an agent doing the research:
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
benchmark-research
Reverse-engineer how selected companies in [INDUSTRY] actually grew, sold, priced, implemented, expanded, and defended their position — then extract reusable patterns. NOT generic company summaries.
Works best for questions like:
- How did the fastest-growing companies in this industry actually scale?
- What sales motion / pricing model / initial wedge worked?
- What implementation / deployment model made customers successful?
- What expansion mechanics created retention and NRR?
- What recurring laws or archetypes appear across the best companies?
Entry-point flow (on trigger)
When the trigger phrase fires, run a short intake before any research:
- Industry / scope. What industry? Why this one? What counts as "fast growth"? What benchmark questions matter? (Phase 0)
- Mode. Full programme (15–25 companies, weeks of work) or MVV (8 companies, lighter — see below)?
- Target company for the private application layer. Is there a "our company" perspective for private recommendations? If yes → public layer + private memo. If no → public benchmark only.
- Project location. Where does
research-project/live? It is NOT inside agencyengagement/— it has its own artefact tree (see "Folder structure" below) and outlives any single session.
Capture these in research-project/README.md and proceed by phase.
Core principle
Strict separation into four layers — do not mix them:
- Source harvest — structured primary-source archive
- Company synthesis — one reverse-engineering memo per company
- Meta-synthesis — cross-company laws, archetypes, patterns
- Application — private recommendations (what to copy / adapt / reject / sequence)
Public benchmark can discuss lessons and boundary conditions. The private application layer says what THIS company should do. Keep them separate if the benchmark will be shared.
Folder structure
research-project/
├── README.md # scope, decisions, current phase
├── source-harvest-phase/
│ └── <company>/
│ ├── company.md
│ ├── TODO-sources.md
│ ├── people/<person>.md
│ └── sources/<source>.md
├── synthesis-phase/
│ ├── <company>/
│ │ ├── research-brief-<company>-playbook.md
│ │ ├── <company>-playbook-analysis.md
│ │ └── <company>-playbook-slides-outline.md
│ ├── meta-synthesis/
│ │ ├── meta-synthesis-industry-benchmark.md
│ │ ├── growth-laws.md
│ │ ├── sales-laws.md
│ │ ├── archetypes.md
│ │ ├── pattern-matrix.md
│ │ ├── company-comparison-table.md
│ │ └── cross-insights.md
│ └── application/
│ ├── application-memo.md
│ ├── priority-matrix.md
│ ├── do-copy-dont-copy.md
│ └── sequencing-roadmap.md
└── publishing-layer/ # optionalThis is not an agency engagement/ directory — it lives outside
the agency whitelist. A benchmark programme spans many sessions; each
session advances one or more phases.
Evidence labels (use everywhere)
| Label | Meaning |
[E] | Directly sourced evidence |
[I] | Inference from sourced facts |
[UV] | Unverified estimate |
[OQ] | Open question |
[H] | Hypothesis to test |
If a claim matters, label it. Do not let elegant writing blur evidence
quality. This is the same discipline reality-checker / skeptic
enforce on agency artefacts.
Source priority
Prefer primary / operator sources. Order:
- Founder / CEO / executive interviews
- Podcasts, talks, conference appearances
- Company-written material — product docs, launch posts, customer stories, trust docs, pricing pages
- Operator posts from people who built the motion
- Job descriptions, org charts
- Customer case studies / quotes
- Partner pages / ecosystem announcements
- Investor memos / analyst reports (clearly labelled)
- News articles only if they contain original facts, quotes, or data
Avoid overweighting: recycled funding news · SEO summaries · unsourced listicles · vague market maps · press with no operator detail.
Company selection
Score each candidate on:
- Growth velocity — scaled unusually fast?
- Relevance — in or near the target industry?
- Evidence availability — enough sources to reverse-engineer the motion?
- Distinctiveness — adds a unique mechanism, not just another copy?
- Transferability — others can learn from it, even if not copy directly?
Tiers:
- Tier 1 — Core benchmark. Directly relevant, strong evidence, clear motion.
- Tier 2 — Boundary case. Not perfectly comparable but teaches a mechanism.
- Tier 3 — Context only. For contrast, not a core example.
Do not include a company just because it is famous. Include it because it teaches a mechanism.
Phase 1 — Source harvest
Goal: structured evidence archive, not a giant narrative report.
Per company, populate source-harvest-phase/<company>/:
company.mdanswers: what the company does · initial wedge · why it matters for this benchmark · known milestones · major open questions.TODO-sources.mdlists: missing high-value interviews · gated pages worth revisiting · missing transcripts · ambiguous claims needing verification · important-but-unsourced claims.sources/<source>.mdper source: title · source type · date · URL · who is speaking · why this source matters · key facts · direct quotes · what it reveals about growth/GTM/pricing/product/adoption · caveats.people/<person>.mdper person: role · relevance to growth story · notable claims/quotes · source references · career pattern if relevant to GTM credibility.
Extract from each source: growth milestones · wedge & initial use case · buyer persona · sales motion · founder-led sales clues · pilot/POC structure · design partner details · pricing & packaging · contract size hints · implementation/deployment model · trust / compliance / security / integration details · customer success motion · expansion / retention mechanics · org buildout & key hires · partner / channel motion · moat & defensibility · non-transferable advantages.
Done criteria: company.md + TODO-sources.md exist · multiple
strong source notes exist · key people notes where relevant · major
GTM / product / pricing / trust questions have at least partial
evidence · remaining gaps explicitly listed.
The reusable harvest prompt: references/source-harvest-prompt.md.
Phase 2 — Company synthesis
Goal: strategy-grade reverse-engineering memo per company.
For each company, produce in synthesis-phase/<company>/:
research-brief-<company>-playbook.md(use template:references/company-launch-template.md)<company>-playbook-analysis.md<company>-playbook-slides-outline.md
Memo structure (11 sections)
- Executive summary — what is the company · why in benchmark · core growth interpretation · sourced vs inferred
- Core motion — initial wedge · target buyer/user · why urgent · category framing
- Growth system decomposition — acquisition channels · conversion mechanisms · trust mechanisms · implementation/activation path · expansion loop
- Unit economics & commercial logic — pricing model · budget replaced/captured · ACV / contract size estimates · gross margin/COGS logic · payback · expansion logic
- Sales cycle reverse engineering — who bought · who used · who blocked · who championed · pilot/POC structure · proof points · procurement/security path · founder-led vs sales-led vs partner-led
- Implementation / deployment model — onboarding sequence · integration requirements · services / forward-deployed / solutions role · customer success model · time to value · scale-up path
- Why the company won — timing · wedge strength · product advantage · distribution advantage · credibility/trust advantage · ecosystem/partner advantage
- Benchmark relevance & transferability boundaries — what this case demonstrates · what is broadly transferable · what should not be copied blindly · what depends on unique market structure
- Factor analysis — McKinsey-style table: factor · evidence · strength · transferability · caveats
- Risks & fragilities — what could break the model · competitive threats · margin/pricing risks · channel risks · customer concentration · regulatory/trust risks
- Final benchmark assessment — tier recommendation · why included/excluded · what future research should verify
Reusable synthesis prompt:
references/synthesis-prompt.md.
Phase 3 — Cross-company meta-synthesis
After enough company memos exist (recommended: ≥6), create:
meta-synthesis-industry-benchmark.mdgrowth-laws.md(or.yaml)sales-laws.mdarchetypes.mdpattern-matrix.mdcompany-comparison-table.mdcross-insights.md
Answer: what patterns repeated · what was rare vs common · what commercial logic appeared repeatedly · what sales tactics repeated · what archetypes emerged · what mechanisms were true exceptions · what changed by subcategory / buyer / market maturity.
Growth laws
Structural patterns in how companies scaled. Per law: id · name ·
short_description · body · prevalence · key_examples ·
anti_pattern · caveats.
Categories to consider: wedge clarity · prestige-first adoption · domain-expert GTM · proof before scale · labor-budget or revenue-budget pricing · expansion flywheel · high-touch implementation as moat · trust architecture · platform expansion after wedge · ICP discovery filter · auditability as GTM mechanism.
Sales laws
Patterns in commercial-motion execution. Same structure as growth laws.
Categories to consider: founders sell first · demo against the customer's own work/data · willingness-to-pay as qualification · paid pilot structure · objector-to-champion conversion · practitioner pull · reference hierarchy · multi-year contracts as switching cost · economic buyer pre-close.
Pattern matrix
Company × pattern table. Cells: confirmed / partial / absent /
unknown — do not force binary labels where evidence is mixed. Use
partial and unknown liberally.
Example fields: company · tier · wedge_clarity · prestige_first · domain_expert_gtm · proof_before_scale · labor_budget_pricing · expansion_flywheel · founder_sells_first · demo_against_own_work · paid_pilot · practitioner_pull · trust_architecture · implementation_moat · evidence_quality (high/medium/low) · notes.
Archetypes
Clusters of companies with similar growth/commercial logic. Per archetype: name · definition · member companies · common wedge · buyer · pricing model · sales motion · implementation model · expansion mechanism · risks · what this archetype teaches.
Do not create a new archetype for every one-off exception. If only one company fits, mark it as a boundary case unless the pattern is strategically important enough to preserve as a future hook.
Cross-insights
Important patterns that may not be universal laws. Per insight: title · summary · evidence · companies involved · confidence level · implications · caveats.
Good cross-insights sound like:
- "Consumption-metered expansion may be a third NRR mechanism."
- "Prestige logos work differently in developer tools than in executive-procured software."
- "Compliance is not a back-office requirement; it is part of GTM."
- "Services-heavy deployment can be a moat when it creates workflow depth."
Phase 4 — Application layer (private)
ONLY after company synthesis and meta-synthesis are complete.
Answers: what should WE copy? · what adapt? · what NOT copy? · what sequence first? · what preconditions must be true before copying? · what would be dangerous cargo-culting?
Deliverables:
application-memo.mdpriority-matrix.md(Pattern · Source companies · Why it worked there · Applicability · Preconditions · Risk if copied blindly · Recommended action)do-copy-dont-copy.mdsequencing-roadmap.md
Keep application recommendations strictly separate from the public benchmark if the benchmark will be shared. Public pages must not leak private company-specific advice.
Quality gates
Before calling a company memo complete:
- Does it explain the growth machine, not just describe the company?
- Are evidence and inference clearly separated?
- Are pricing and economics addressed?
- Is sales cycle reverse-engineered?
- Is implementation / deployment model addressed?
- Is expansion logic explicit?
- Are non-transferable advantages identified?
- Are open questions listed?
Before calling meta-synthesis complete:
- Are laws based on multiple companies, not one anecdote?
- Are exceptions labelled as exceptions?
- Are boundary cases separated from core patterns?
- Are prevalence estimates honest?
- Do archetypes group mechanisms, not vibes?
- Does the pattern matrix reflect evidence quality?
Before publishing:
- Are public and private layers separated?
- Are source references preserved?
- Are unverified estimates labelled?
- Are generated pages checked for private leakage?
- Are stale claims removed after refactors?
Anti-patterns
- Generic company summaries. Bad: "Company X is a leading platform that helps teams…" Good: "Company X won by starting with workflow Y, proving metric Z in pilot, then expanding via mechanism A."
- Funding-news overweighting. Funding is not a growth machine. Only use funding news if it includes original metrics, customer facts, or operator quotes.
- Unlabeled inference. If inferred, say it is inference.
- Overfitting one company into a law. One company creates an emerging insight, not a universal law.
- Confusing public pricing with actual economics. Public tiers may be entry points; real revenue may come from usage, enterprise contracts, services, volume, or expansion.
- Mixing product adoption with revenue mechanism. "Users like it" ≠ "this is how the business scales."
- Treating implementation as boring. In many enterprise categories, implementation IS the moat.
- Cargo-culting prestige customers. Prestige-first works when peer trust matters; not in all markets.
- Publishing private recommendations. Public = benchmark lessons; private = company-specific advice.
- Not updating cross-synthesis after new company research. Every strong new memo should trigger a review of laws, matrix, archetypes, cross-insights.
Suggested sequence
| Phase | What |
| 0 | Define scope — target industry · why · what counts as fast growth · benchmark questions |
| 1 | Candidate map — list 30–50 companies · score · choose first 10–20 |
| 2 | Source harvest — one company at a time · primary/operator sources · structured archive · explicit gaps |
| 3 | Company synthesis — full reverse-engineering memo per company · slide outline · evidence-tagged |
| 4 | Meta-synthesis — growth/sales laws · archetypes · pattern matrix · comparison table · cross-insights |
| 5 | Application — what to copy/adapt/reject · sequence · preconditions · risk of blind copying |
| 6 | Publishing (optional) — public benchmark layer · private application layer · keep private out of public |
Minimum Viable Version
Lightweight starter:
- Pick 8 companies.
- For each, collect 5–10 strong sources.
- Write one memo per company using the standard structure.
- Build one pattern matrix.
- Extract 5 growth laws + 5 sales laws.
- Write a 5-page application memo.
Enough to be useful. Full version expands to 15–25 companies and a publishable site.
Agent activation prompt
Use as the system / task instruction for an agent doing the research:
You are building a benchmark research corpus for [INDUSTRY]. Your job is to reverse-engineer how selected companies actually scaled. Do not write generic company summaries. Always separate evidence from inference. Prefer primary/operator sources. Maintain the project folder structure. For each company, first build a source archive, then a synthesis memo. After multiple company memos exist, extract cross-company laws, archetypes, and comparison matrices. Keep private application recommendations separate from public benchmark research. When uncertain, write TODO / open question instead of inventing certainty.
Per-phase reusable prompts live in references/:
references/source-harvest-prompt.mdreferences/synthesis-prompt.mdreferences/company-launch-template.md
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

