scrapy-consistency

scrapy-consistency

An agent skill that makes generated scrapy code consistent: one canonical, modern idiom set instead of a mix of legacy and current APIs.

What it does

Scrapy is stable, but generated spiders mix eras: deprecated .extract_first() next to .get(), manual urljoin + Request instead of response.follow, blocking requests calls inside callbacks, hand-written file output instead of feed exports. This skill pins the canonical 2.x spider structure and catalogs the patterns that silently drop or duplicate scraped data.

Install

skills.sh

npx skills add guidogl/scrapy-consistency

Claude Code plugin marketplace

/plugin marketplace add guidogl/scrapy-consistency

Contents

• SKILL.md — the skill instructions: canonical idioms, pitfalls, version notes, workflow.
• references/scrapy-patterns.md — deep reference: legacy→modern migration map and expanded per-topic patterns, gotchas, and code examples.

License

Apache-2.0 — see LICENSE.txt.