Web Scraping & Data Collection Claude 스킬

Z.AI Intelligence CLI

Integrates advanced vision analysis, real-time web search, and GitHub exploration tools directly into the Claude Code environment.

Twitter Data Extraction (twscrape)

Extracts Twitter/X data using the GraphQL API with automated account rotation and session management.

Alpha Finder

Gathers real-time market intelligence from across the web and social media to inform prediction market trading decisions.

Professional People Search

Conducts real-time OSINT research to retrieve verified career timelines, professional backgrounds, and biographical data for individuals and entities.

TripIt Data Exporter

Exports comprehensive TripIt travel data including trips, flights, and lodging into a structured JSON format via browser automation.

Tavily Web Search & Research

Integrates high-performance web search, content extraction, and site crawling capabilities using the Tavily API for real-time information retrieval.

Job Description Parser

Extracts structured requirements and metadata from job descriptions to facilitate automated candidate matching and recruitment analysis.

Playwright Web Scraper

Extracts structured data from complex websites using a robust, three-phase Playwright automation workflow.

Tavily Web Search

Empowers Claude to perform advanced web searches, crawl websites, and extract high-quality content using the Tavily AI search engine.

Exa Semantic Search

Performs neural, semantic web searches and content discovery using the Exa API to find highly relevant data and research.

Tavily Web Search & Extraction

Integrates real-time web search and content extraction capabilities into Claude Code using the Tavily API.

Documentation Crawler

Automates the process of crawling, extracting, and converting documentation websites into structured Markdown or Claude Code skills.

Exa Semantic Search

Performs semantic web searches and similar content discovery using the Exa API to retrieve high-quality research data.

Weather Data Fetcher

Retrieves real-time temperature data from the wttr.in API for specific geographic locations.

Web Search

Retrieves real-time information, news, images, and videos from the web using DuckDuckGo to provide up-to-date data and resources.

Video Subtitle Extractor

Extracts and cleans transcripts from global video platforms like YouTube and Bilibili into readable text files.

Firecrawl Scraper

Extracts deep web content, parses PDFs, and captures screenshots using the Firecrawl API directly within Claude Code.

Unified Research

Aggregates data from multiple search APIs like Tavily, SerpAPI, and Perplexity to provide comprehensive, fact-based research summaries.

Firecrawl Web Scraper

Extracts structured data, captures screenshots, and parses PDFs from complex websites using the Firecrawl API.

Firecrawl Scraper

Automates deep web scraping, PDF parsing, and visual snapshots using the Firecrawl API.

Competitive Ads Extractor

Scrapes and analyzes competitor advertisements from major ad libraries to identify successful messaging, creative patterns, and market positioning.

Exa Semantic Search

Performs high-precision semantic searches and intent-based research using the Exa AI search engine.

Blog & RSS Monitor

Monitors and manages updates from blogs and RSS/Atom feeds directly through the CLI.

YouTube Transcript & Data API

Retrieves YouTube transcripts, searches channels, and extracts video metadata for content analysis and automation.

Valyu Search & Research Toolkit

Empowers Claude with multi-domain search, AI-driven answers, content extraction, and comprehensive deep research reporting.

Doc Site Analysis

Analyzes API documentation structures to identify data extraction patterns for automated scraper generation.

Scraper Code Generator

Generates high-performance, robust Python code for scraping and parsing structured API documentation from HTML.

Smart Link Extractor

Extracts core resources from social media and technical blogs to generate structured Markdown archives with intelligent categorization.

bioRxiv Preprint Search

Accesses and retrieves research papers from the bioRxiv preprint server for literature reviews and trend analysis.

Article Extractor

Extracts clean, readable text from web articles and blog posts by removing ads, navigation, and clutter.