Web Scraping & Data Collection Claudeスキル

Professional People Search

Conducts real-time OSINT research to retrieve verified career timelines, professional backgrounds, and biographical data for individuals and entities.

Firecrawl Scraper

Extracts clean, structured data from any website using the powerful Firecrawl API for deep web crawling and scraping.

YouTube Transcript Extractor

Extracts high-quality subtitles and transcripts from YouTube videos in multiple formats and languages for analysis and automation.

Documentation Crawler

Automates the process of crawling, extracting, and converting documentation websites into structured Markdown or Claude Code skills.

Exa Semantic Search

Powers Claude Code with semantic search, similar content discovery, and structured research capabilities via the Exa API.

Weather Data Fetcher

Retrieves real-time temperature data from the wttr.in API for specific geographic locations.

Web Search

Retrieves real-time information, news, images, and videos from the web using DuckDuckGo to provide up-to-date data and resources.

Video Subtitle Extractor

Extracts and cleans transcripts from global video platforms like YouTube and Bilibili into readable text files.

Unified Research

Aggregates data from multiple search APIs like Tavily, SerpAPI, and Perplexity to provide comprehensive, fact-based research summaries.

Video Downloader

Automates video and audio downloads from various web platforms with customizable quality and format settings using yt-dlp.

Article Extractor

Extracts clean, readable text from web articles and blog posts by removing ads, navigation, and clutter.

Wget URL Reader

Fetches and downloads content from any URL using the powerful wget command-line utility.

Article Extractor

Extracts clean, readable text from web articles and blog posts by removing ads, navigation, and clutter.

Firecrawl Real Estate Scraper

Extracts structured property data from real estate listing URLs using Firecrawl AI for market analysis and content creation.

JRA-VAN Keiba Data Pipeline

Automates the retrieval of JRA-VAN horse racing data and facilitates seamless loading into PostgreSQL databases.

Web Research Agent

Executes multi-perspective web searches and generates structured research reports with source attribution and uncertainty analysis.

Threads Scraper

Scrapes and extracts post data from Threads profiles using automated browser navigation and authentication.

RuTracker Torrent Manager

Automates searching, filtering, and downloading torrents from RuTracker using Playwright and aria2c.

Markdown URL Extractor

Converts web URLs into clean, raw markdown to minimize context window usage and eliminate HTML noise.

APOD Downloader

Downloads NASA's Astronomy Picture of the Day along with detailed metadata directly to your desktop.

YouTube Video Downloader

Downloads YouTube videos and audio with customizable quality and format settings directly through the terminal.

Brave Search Integration

Performs headless web searches and extracts readable markdown content using the Brave Search API without requiring a browser.

Blockchain Data Pipeline Validation

Validates blockchain data collection pipelines using a systematic 5-step empirical workflow to ensure data integrity and storage efficiency.

Playbooks Fetch

Converts any URL into clean, structured Markdown with YAML metadata for efficient content consumption and LLM processing.

Insight Extractor

Extracts valuable insights and key information from URLs or text documents to streamline information processing.

Market Research Setup

Configures the essential Brave Search MCP integration and environment settings required for automated market research workflows.

Research Patterns & Workflow

Standardizes deep research workflows in Claude Code through consistent naming conventions, structured output formats, and intelligent source selection.

bioRxiv Database Search

Searches and retrieves life sciences preprints from the bioRxiv database using keywords, authors, and DOIs.

Website Crawler

Maps complex website structures and discovers URLs using a high-performance Go-powered engine with TypeScript integration.

Hot List Data Enrichment

Automates company data enrichment for investment dashboards by fetching employee counts, job postings, and news mentions.