doc-fetcher

Doc Fetcher - Claude Code Plugin

Fetch, cache, and version documentation from web sources to provide accurate, version-specific context for AI coding agents.

Usage Instructions

Problem Solved

AI coding agents frequently struggle with:

• Using outdated documentation (e.g., Next.js 13 patterns when working with Next.js 15)
• Mixing information from multiple library versions
• Losing context when documentation sites restructure
• Inconsistent responses based on training data vs. current docs

Doc Fetcher solves this by creating versioned snapshots of documentation that can be cached locally and referenced by Claude Code skills, ensuring accurate, version-specific guidance.

Features

• AI-First: Checks for llms.txt and claude.txt before web crawling
• Smart Crawling: Auto-detects documentation frameworks (Docusaurus, VitePress, Nextra, GitBook, etc.)
• Robots.txt Compliance: Respects webmaster preferences, honors crawl delays, prevents IP bans
• Enhanced Error Recovery: Automatic checkpoint/resume for interrupted crawls, intelligent retry with adaptive backoff
• Version Management: Cache multiple versions, pin to project dependencies
• Auto-Generated Skills: Automatically creates Claude Code skills from cached docs
• Project Integration: Detects dependencies from package.json and suggests fetching relevant docs
• Incremental Updates: Only re-fetch changed pages when updating
• Offline-Ready: Documentation works without internet once cached

Architecture

Doc Fetcher uses a global cache architecture - documentation and skills are stored in your home directory and shared across all projects:

~/.claude/
├── docs/              # Cached documentation (shared across all projects)
│   ├── nextjs/
│   │   ├── 14.2.3/   # Multiple versions supported
│   │   └── 15.0.3/
│   ├── react/
│   │   └── 18.2.0/
│   └── supabase/
│       └── 2.39.0/
└── skills/            # Generated skills (available globally)
    ├── nextjs-15-expert/
    ├── react-18-expert/
    └── supabase-2-expert/

Benefits:

• Documentation is cached once and reused across all projects
• No duplicate downloads - saves bandwidth and disk space
• Skills work everywhere - generate once, use in any project
• Project directories stay clean - no large .claude/docs folders

Installation

Via Claude Code Marketplace

/plugin marketplace add squirrelsoft-dev/squirrelsoft-marketplace
/plugin install doc-fetcher@squirrelsoft-dev

Manual Installation

1. Clone this repository:

git clone https://github.com/squirrelsoft-dev/doc-fetcher
cd doc-fetcher

2. Link to your Claude Code plugins directory:

ln -s $(pwd) ~/.claude/plugins/doc-fetcher

3. Restart Claude Code

Quick Start

1. Fetch Documentation

# Fetch latest Next.js documentation
/doc-fetcher:fetch-docs nextjs

# Fetch specific version
/doc-fetcher:fetch-docs nextjs 15.0.3

# Fetch from custom URL
/doc-fetcher:fetch-docs my-lib --url https://docs.mylib.com

2. List Cached Documentation

# List all cached docs
/doc-fetcher:list-docs

# List docs for current project
/doc-fetcher:list-docs --project

3. Update Documentation

# Update specific library
/doc-fetcher:update-docs nextjs

# Update all cached docs
/doc-fetcher:update-docs --all

# Update docs matching package.json
/doc-fetcher:update-docs --project

4. Generate Skills

# Generate expert skill from cached docs
/doc-fetcher:generate-skill nextjs

# Use specific template
/doc-fetcher:generate-skill nextjs --template quick-reference

Usage Examples

New Project Setup

# Starting a new Next.js + Supabase project

# Fetch documentation for your stack
/doc-fetcher:fetch-docs nextjs 15.0.3
/doc-fetcher:fetch-docs react 18.2.0
/doc-fetcher:fetch-docs supabase 2.39.0

# Or automatically detect and fetch from package.json
/doc-fetcher:fetch-docs --project

# Claude now has accurate context for your entire stack

Version Upgrade

# Upgrading Next.js from 14 to 15

# Fetch new version docs
/doc-fetcher:fetch-docs nextjs 15.0.0

# Generate migration guide skill
/doc-fetcher:generate-skill nextjs --template migration-guide

# Ask Claude: "What are the breaking changes in Next.js 15?"

Weekly Maintenance

# Keep documentation current

# Check what needs updating
/doc-fetcher:list-docs --project

# Update all project docs
/doc-fetcher:update-docs --project

Commands

/doc-fetcher:fetch-docs <library> [version] [options]