Generates high-performance, robust Python code for scraping and parsing structured API documentation from HTML.
This skill equips Claude with specialized patterns and best practices for building production-grade API documentation scrapers. It focuses on using modern Python libraries like httpx for async requests, selectolax for high-speed parsing, and Pydantic for data validation. By implementing multi-strategy extraction and defensive error handling, it ensures that generated scrapers can reliably extract endpoints, parameters, and schemas even from complex or malformed HTML documentation sites.
主な機能
01Async-capable HTTP request logic with httpx and tenacity retry strategies
02Multi-strategy extraction patterns for endpoints, tables, and section boundaries
030 GitHub stars
04Validated data structures using Pydantic v2 for type-safe extraction
05High-speed HTML parsing patterns using selectolax CSS selectors
06Defensive coding practices to handle malformed HTML and edge cases
ユースケース
01Automating data extraction from legacy developer portals without public APIs
02Building scrapers to convert HTML API documentation into structured OpenAPI specifications
03Creating maintainable web scraping pipelines for frequently updated documentation sites
