web-crawler

Firecrawl v2.5 API for web scraping/crawling to LLM-ready markdown. Use for site extraction, dynamic content, or encountering JavaScript rendering, bot detection, content loading errors.

Scrape, search, crawl, and map the web with a single command.

Claude Code skill pack for FireCrawl (30 skills)

Build AI applications with real-time web data using Tavily's search, extract, crawl, and research APIs.

Pull server-rendered web content from any URL into Claude Code. Indexes sites in seconds with conditional-GET caching, then exposes them as MCP tools (fetch_url, ensure_docs, list_sources, list_indexed, grep_docs, read_doc, add_source, remove_source). Local, browser-free, no API keys.

Ultra-compressed communication mode. Cuts ~75% of tokens while keeping full technical accuracy by speaking like a caveman.