Web Scraping & Data Collection Claudeスキル

Exa Semantic Search

Performs semantic web searches and similar content discovery using the Exa API to retrieve high-quality research data.

Tavily Web Search & Extraction

Integrates real-time web search and content extraction capabilities into Claude Code using the Tavily API.

Exa Semantic Search

Performs neural, semantic web searches and content discovery using the Exa API to find highly relevant data and research.

Tavily Web Search

Empowers Claude to perform advanced web searches, crawl websites, and extract high-quality content using the Tavily AI search engine.

Playwright Web Scraper

Extracts structured data from complex websites using a robust, three-phase Playwright automation workflow.

Job Description Parser

Extracts structured requirements and metadata from job descriptions to facilitate automated candidate matching and recruitment analysis.

Tavily Web Search & Research

Integrates high-performance web search, content extraction, and site crawling capabilities using the Tavily API for real-time information retrieval.

Web Scraping & Content Extraction Tools

Automates documentation collection and structured data extraction using Playwright, BeautifulSoup, and Scrapy templates.

Twitter Data Extraction (twscrape)

Extracts Twitter/X data using the GraphQL API with automated account rotation and session management.

Z.AI Intelligence CLI

Integrates advanced vision analysis, real-time web search, and GitHub exploration tools directly into the Claude Code environment.

Crypto News Aggregator

Aggregates and filters real-time cryptocurrency news from over 50 authoritative sources with automated relevance scoring.

Exa SDK Installation & Authentication

Configures Exa SDKs and handles API authentication for AI-powered search and data retrieval.

Firecrawl Architecture Variants

Architects scalable Firecrawl integrations using validated monolith, service layer, and microservice patterns.

FireCrawl Cost Optimization

Optimizes FireCrawl API expenses through intelligent tier selection, usage monitoring, and request efficiency strategies.

Exa Core Secondary Workflow

Executes secondary search and data retrieval workflows using the Exa API to complement primary AI-driven discovery tasks.

FireCrawl Core Workflow

Executes the primary FireCrawl workflow to transform web content into structured data for AI applications.

FireCrawl Performance Tuning

Optimizes FireCrawl API integrations using advanced caching, request batching, and connection pooling strategies.

FireCrawl Installation and Authentication

Installs and configures the FireCrawl SDK and CLI with secure API authentication for web scraping workflows.

FireCrawl Reliability Patterns

Implements robust error handling and fault-tolerance patterns for stable FireCrawl web scraping integrations.

Exa API Troubleshooting

Diagnoses and resolves common Exa API errors and integration issues to ensure reliable AI search functionality.

FireCrawl Reference Architecture

Implements production-ready architectural patterns and structured project layouts for FireCrawl web scraping integrations.

FireCrawl Secondary Workflow B

Executes optimized secondary FireCrawl data extraction tasks to complement primary web scraping workflows.

FireCrawl Rate Limit Handler

Implements resilient FireCrawl API interactions using exponential backoff, jitter, and idempotency patterns.

FireCrawl Pitfall Guard

Audits and optimizes FireCrawl implementations by identifying common anti-patterns and security vulnerabilities.

FireCrawl Quick Start

Bootstraps a minimal FireCrawl integration to verify API connectivity and client initialization.

Video Downloader

Downloads high-quality videos and audio from YouTube and other platforms for offline viewing, archiving, and editing.

FireCrawl SDK Upgrade & Migration

Streamlines FireCrawl SDK upgrades by identifying breaking changes and automating version migrations across your codebase.

PySpider Development Toolkit

Streamlines the creation of production-ready PySpider web crawlers using standardized templates, advanced scraping patterns, and enterprise-grade best practices.

Zhipu AI Search

Performs intelligent web searches via the Zhipu search engine with automated relative date resolution.

FireCrawl Webhooks & Events

Secures and processes FireCrawl webhook notifications with robust signature validation and automated event routing.