Maps entire website structures and discovers specific URLs rapidly without extracting full page content.
Tavily Site Mapping is a specialized Claude Code skill designed for high-speed URL discovery and website structure visualization. By utilizing the Tavily CLI, it allows users to find specific subpages on large domains, generate full sitemaps, and filter links using natural language instructions or regex patterns. This skill serves as an essential preliminary step in data collection workflows, enabling developers to identify the exact pages they need before committing to more resource-intensive content extraction or crawling tasks.
主な機能
01Configurable depth and breadth for mapping complex site architectures
02Advanced path and domain filtering using regex patterns
03Rapid URL discovery without the overhead of content extraction
04Natural language filtering to find specific pages using semantic instructions
05213 GitHub stars
06Seamless integration with extraction tools for targeted data retrieval
ユースケース
01Generating a comprehensive list of URLs to plan a focused web scraping project
02Locating specific documentation or API endpoints on a massive enterprise website
03Analyzing site architecture and hierarchy for SEO or development audits
