MCPInstall

crawl4ai-skill

1 skill from brettdavies/crawl4ai-skill · 1.1K installs

Install every skill in this repository:

npx skills add https://github.com/brettdavies/crawl4ai-skill
  1. 1

    Use when scraping JavaScript-heavy pages or SPAs, crawling multiple URLs concurrently, extracting structured data with reusable CSS/JSON schemas, or building automated web data pipelines. Wraps the Crawl4AI library (crwl CLI and Python SDK) with schema-generation patterns for LLM-free extraction. Triggers on crawl4ai, crwl, scrape JS-heavy site, scrape SPA, headless browser scrape, schema-based extraction, batch crawl, sitemap crawl, web data pipeline. SKIP when a static HTML page can be read with defuddle / fetch-web — those are faster cold-start and don't need a browser.