Web Scraping & Data Collection Claudeスキル

BrightData Scraper

Implements a progressive four-tier scraping strategy to retrieve content from any URL while bypassing bot detection and CAPTCHAs.

Bright Data Advanced Scraper

Executes a progressive four-tier scraping strategy to reliably extract content from websites while bypassing bot detection and CAPTCHAs.

Bright Data Scraper

Automates multi-tier web scraping with an intelligent fallback strategy to bypass bot detection and capture content from any URL.

Bright Data Progressive Scraper

Automates web content retrieval using a four-tier escalation strategy to bypass bot detection and CAPTCHAs.

Bright Data Progressive Scraper

Automates resilient web content extraction using a four-tier fallback strategy to bypass bot detection and JavaScript hurdles.

Web Research Assistant

Orchestrates parallel subagents to perform structured, multi-source web investigations and synthesize findings into comprehensive reports.

YouTube Transcript Extractor

Extracts and cleans transcripts from YouTube videos for quick reading and summarization.

WASDE Data Ingestor

Automates the extraction and parsing of monthly USDA WASDE reports into standardized datasets for agricultural market analysis.

Google Trends ATH Detector

Detects and analyzes Google Trends search spikes and all-time highs using automated browser simulation and statistical modeling.

China Macro News Aggregator

Aggregates and summarizes real-time China macro-economic news from premium financial sources into professional magazine-style reports.

VeyraX MCP Installer

Automates the installation and configuration of the VeyraX MCP server for enhanced web search and content extraction.

Jina AI MCP Reader

Installs and configures the Jina AI MCP server to enable high-quality web scraping and URL content extraction within Claude Code.

WebMind DOM Analyzer MCP

Integrates the WebMind MCP server into Claude Code to provide advanced DOM analysis and specialized Ragic assistant capabilities.

Gemini Web Search

Performs advanced web searches using Gemini to retrieve real-time, high-relevance information for complex technical queries.

Genome Assembly Dataset Curator

Automates the end-to-end processing and metadata curation of genome assembly datasets for VEuPathDB resources.

CASS Freight Inflation Detector

Monitors the CASS Freight Index to identify economic cycle turns and predict US inflation trends through logistics data analysis.

Rolex Market Liquidity Proxy Analyzer

Analyzes global liquidity and risk-on sentiment by using the Rolex Market Index as a high-beta proxy for financial conditions.

Crawl4AI

Crawls entire websites and extracts clean, structured content into markdown files with AI-enriched metadata.

YT-DLP Video Downloader

Downloads audio and video from thousands of websites with advanced control over formats, subtitles, and metadata.

Competition Scraper & GitHub Persister

Scrapes Australian creative writing competitions and automatically manages them as structured GitHub issues with intelligent duplicate detection.

Pure.md MCP Installer

Automates the installation and configuration of the Pure.md MCP server for seamless web-to-markdown conversion within Claude Code.

YouTube Info MCP Installer

Installs and configures the YouTube Info MCP server to enable automated extraction of video metadata and details within Claude Code.

Competitive Research with Bright Data

Conducts enterprise-grade company research, competitive analysis, and market intelligence using professional web scraping and search tools.

Industry Research

Conducts comprehensive market analysis and trend forecasting across the consumer, technology, healthcare, and finance sectors.

Research Reporter

Automates information gathering from web searches and authoritative sources to generate and save structured research reports.

MCP Opportunity Pipeline

Automates the end-to-end lifecycle of discovering, validating, building, and publishing Model Context Protocol (MCP) servers and automation tools.

Add Awesome Tool

Analyzes AI tool URLs to extract metadata and automatically categorizes and adds them to the awesome-ai-tools repository.

Web Connectivity and Search

Searches the internet and converts live webpage content into markdown for real-time information retrieval and analysis.

Scanner PDF Analysis

Analyzes PDF documents to extract structured data, including tables, section headers, and metadata, while providing automated summaries.

Scanner Excel Extraction

Extracts, transforms, and structures data from complex Excel files into JSON or CSV formats.