agentleFS
sitetillersitetiller/ai-visibility-skills/skills/cannibalization/SKILL.md

cannibalization

Skill0 starsChanged 2 days agoMITView on GitHub

Find queries where two or more of your own URLs compete in Google results, decide per case whether to merge, differentiate or leave them alone, and merge with permanent 301 redirects the way Google's redirect and consolidation documentation describes. Uses the cannibal command on a Search Console query+page export. Use when the user says 'keyword cannibalization', 'two pages ranking for the same query', 'which page should rank', 'merge pages', 'consolidate duplicate content', 'my rankings flip between pages'.

2 other projects use a version of this.

Adopted by

Most recently taken up by

The file

We split this skill into the rules it gives an agent

7 rules. About 0 are common, 5 are distinctive, and 2 are very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈5

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 2

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  • could be automatic: a setting could enforce it
  1. Very specific:

    Do not use noindex to pick a winner inside the site.

    line 48
  2. Very specific:

    Update internal links and the sitemap to the target.

    line 49
  3. Distinctive:

    Do not chain redirects.

    line 50
  4. Distinctive:

    Do not call impressions-sharing a penalty.

    line 60
  5. Distinctive:

    Do not merge pages with different intents to "concentrate" signals.

    line 61
  6. Distinctive:

    Do not use noindex or robots.txt to resolve overlap.

    line 62
  7. Distinctive:

    Do not trust a single period: re-check with the 90-day window before merging.

    line 64

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Cannibalization: evidence, then a decision

Google documents no "keyword cannibalization" penalty. What the data shows is several of your URLs getting impressions for one query. Sometimes that is harmless (two different results both shown), sometimes it splits links and signals across near-duplicate pages. The skill separates the two cases with data and intent, then picks the lightest action.

Inputs

  • A query+page export for 90 days or more (gsc --dims query,page --out qp.csv, see gsc-bing). Positions and impressions are needed, not only clicks.
  • The user's list of pages that may be edited or redirected.

Steps

  1. Export, then find overlaps:
    npx sitetiller gsc example.com --start 2026-08-12 --end 2026-11-09 --dims query,page --out qp.csv
    npx sitetiller cannibal qp.csv --min-imp 50 --json
    Output: an array of {query, impressions, urls: [{page, impressions, share, clicks, position}]}. A query is listed when the second URL holds at least 20% of the query's impressions (rows under --min-imp impressions are ignored). Sorted by total impressions. Averages over the period can hide that the pages alternate by day; position here is the period average from Search Console.
  2. Drop false positives before deciding:
    • Same page under URL variants (parameters, trailing slash, http/https): that is a canonical problem; see canonicals.
    • Brand queries where the home page and a product page both appear: usually fine.
    • Different intents: a "what is" guide and a "pricing" page matching one broad query.
  3. For each remaining query, read both pages:
    npx sitetiller page https://example.com/invoice-template --json
    npx sitetiller page https://example.com/invoice-template-word --json
    Compare title, h1, headings, words, canonical. Answer: do they serve the same intent, in the same format, for the same reader?
  4. Decide with the table.
SituationDecisionAction
Same intent, near-duplicate content, one clearly stronger (more clicks, better position)MergeMove any unique, useful content to the stronger page, then 301 the weaker URL to it. Update internal links to the target
Same intent, both weak, similarMergeCombine into the page with the better URL and links; 301 the other
Different intents on one broad query (guide vs product, free vs paid)DifferentiateSharpen each page's title, H1 and opening to its own intent; link the guide to the product page with a descriptive anchor; do not merge
Both pages rank in the top results and both get clicksLeaveMonitor; occupying two spots is not a defect
Duplicate must stay accessible (print version, campaign URL, parameter)Canonicalrel="canonical" to the main URL, see canonicals
Page has traffic from other queries the target will not serveDo not mergeDifferentiate instead
  1. Merge safely (only for pages the user owns and approved):
    • Use a permanent server-side redirect (HTTP 301 or 308) from the old URL to the new one. Google says server-side redirects are the most reliable and recommended option, and that permanent redirects signal the target should be canonical. Instant meta refresh and JavaScript redirects are weaker; JavaScript is a last resort.
    • Redirect to the closest equivalent page, not to the home page.
    • Do not use noindex to pick a winner inside the site; Google says to use redirects or rel="canonical" instead.
    • Update internal links and the sitemap to the target; remove the old URL from the sitemap. See redirects-migration for checking the map.
    • Do not chain redirects.
  2. Measure with measure-rollback: snapshot both pages, apply the change, then compare the combined clicks of the merged group against control pages over 28 days. For a merge, sum clicks of old and new URLs for both periods. If the combined result loses, restore the old pages from the stored versions.

Output to the user

  1. Table per overlap: query, URLs with impression share, positions, intent read, decision, reason.
  2. The redirect map (old, new, status) for merges, and the link edits.
  3. What was left alone and why.
  4. Measurement plan and the combined-clicks baseline.

Guardrails

  • Do not call impressions-sharing a penalty. Say what the data shows.
  • Do not merge pages with different intents to "concentrate" signals.
  • Do not use noindex or robots.txt to resolve overlap; robots.txt can leave blocked URLs indexed without content, per Google.
  • Redirect only URLs the user owns and approved, to a relevant target. Never redirect to unrelated pages to pass traffic.
  • Do not trust a single period: re-check with the 90-day window before merging.

References

  • references/sources.md

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.