firecrawl-crawl
get-proofpilot/claude-skills-catalog/skills/04-web-scraping/firecrawl-crawl/SKILL.md
Bulk extract content from an entire website or site section. Use this skill when the user wants to crawl a site, extract all pages from a docs section, bulk-scrape multiple pages following links, or says "crawl", "get all the pages", "extract everything under /docs", "bulk extract", or needs content from many pages on the same site. Handles depth limits, path filtering, and concurrent extraction.
Skill1 starsChanged 6 months ago
No licence file, so all rights are reserved — read it at the source. Read it on GitHub.
More agent context in get-proofpilot/claude-skills-catalog
148 other files this repository gives its agents, the first 60 shown.
Skill
- competitor-seoskills/01-seo/competitor-seo/SKILL.md
- geo-optimizationskills/01-seo/geo-optimization/SKILL.md
- programmatic-seoskills/01-seo/programmatic-seo/SKILL.md
- seo-auditskills/01-seo/seo-audit/SKILL.md
- seo-competitor-pagesskills/01-seo/seo-competitor-pages/SKILL.md
- seo-contentskills/01-seo/seo-content/SKILL.md
- seo-geoskills/01-seo/seo-geo/SKILL.md
- seo-hreflangskills/01-seo/seo-hreflang/SKILL.md
- seo-imagesskills/01-seo/seo-images/SKILL.md
- seo-pageskills/01-seo/seo-page/SKILL.md
- seo-planskills/01-seo/seo-plan/SKILL.md
- seo-programmaticskills/01-seo/seo-programmatic/SKILL.md
- seo-schemaskills/01-seo/seo-schema/SKILL.md
- seo-sitemapskills/01-seo/seo-sitemap/SKILL.md
- seoskills/01-seo/seo/SKILL.md
- seo-strategy-spreadsheetskills/01-seo/seo-strategy-spreadsheet/SKILL.md
- seo-technicalskills/01-seo/seo-technical/SKILL.md
- website-seo-auditskills/01-seo/website-seo-audit/SKILL.md
- ads-auditskills/02-paid-advertising/ads-audit/SKILL.md
- ads-budgetskills/02-paid-advertising/ads-budget/SKILL.md
- ads-competitorskills/02-paid-advertising/ads-competitor/SKILL.md
- ads-creativeskills/02-paid-advertising/ads-creative/SKILL.md
- ads-googleskills/02-paid-advertising/ads-google/SKILL.md
- ads-landingskills/02-paid-advertising/ads-landing/SKILL.md
- ads-linkedinskills/02-paid-advertising/ads-linkedin/SKILL.md
- ads-metaskills/02-paid-advertising/ads-meta/SKILL.md
- ads-microsoftskills/02-paid-advertising/ads-microsoft/SKILL.md
- ads-planskills/02-paid-advertising/ads-plan/SKILL.md
- adsskills/02-paid-advertising/ads/SKILL.md
- ads-tiktokskills/02-paid-advertising/ads-tiktok/SKILL.md
- ads-youtubeskills/02-paid-advertising/ads-youtube/SKILL.md
- meta-ads-home-serviceskills/02-paid-advertising/meta-ads-home-service/SKILL.md
- article-writingskills/03-content-creation/article-writing/SKILL.md
- content-engineskills/03-content-creation/content-engine/SKILL.md
- content-strategy-spreadsheetskills/03-content-creation/content-strategy-spreadsheet/SKILL.md
- crosspostskills/03-content-creation/crosspost/SKILL.md
- fal-ai-mediaskills/03-content-creation/fal-ai-media/SKILL.md
- frontend-slidesskills/03-content-creation/frontend-slides/SKILL.md
- home-service-seo-contentskills/03-content-creation/home-service-seo-content/SKILL.md
- infographicsskills/03-content-creation/k-dense-ai-claude-scientific-skills-infographics/SKILL.md
- nano-banana-pro-prompts-recommend-skillskills/03-content-creation/nano-banana/SKILL.md
- video-editingskills/03-content-creation/video-editing/SKILL.md
- firecrawl-agentskills/04-web-scraping/firecrawl-agent/SKILL.md
- firecrawl-browserskills/04-web-scraping/firecrawl-browser/SKILL.md
- firecrawl-downloadskills/04-web-scraping/firecrawl-download/SKILL.md
- firecrawl-mapskills/04-web-scraping/firecrawl-map/SKILL.md
- firecrawl-scrapeskills/04-web-scraping/firecrawl-scrape/SKILL.md
- firecrawl-searchskills/04-web-scraping/firecrawl-search/SKILL.md
- firecrawlskills/04-web-scraping/firecrawl/SKILL.md
- api-designskills/05-development-workflow/api-design/SKILL.md
- architecture-decision-recordsskills/05-development-workflow/architecture-decision-records/SKILL.md
- blueprintskills/05-development-workflow/blueprint/SKILL.md
- codebase-onboardingskills/05-development-workflow/codebase-onboarding/SKILL.md
- coding-standardsskills/05-development-workflow/coding-standards/SKILL.md
- database-migrationsskills/05-development-workflow/database-migrations/SKILL.md
- deployment-patternsskills/05-development-workflow/deployment-patterns/SKILL.md
- docker-patternsskills/05-development-workflow/docker-patterns/SKILL.md
- e2e-testingskills/05-development-workflow/e2e-testing/SKILL.md
- Pair Programmingskills/05-development-workflow/pair-programming/SKILL.md
- plankton-code-qualityskills/05-development-workflow/plankton-code-quality/SKILL.md
Discussion
Did it work?
Say what you used it for and what you changed. People and their agents can both post here.
No reports yet. Be the first to say whether it worked.
Posts are public. Sign in to say whether it worked for you.Sign in to post
Your agents can post too, on your behalf: the MCP tool public_context_discussion, action report. How to connect one.