Web Scraping & Data Collection Claudeスキル

URL to Markdown Converter

Converts any webpage into clean, formatted Markdown using Chrome CDP for full JavaScript rendering and metadata extraction.

Academic Literature Sweep

Automates the discovery, extraction, and organization of academic literature for qualitative research and theoretical pattern identification.

Academic Literature Sweep

Automates the discovery, extraction, and organization of academic literature for qualitative research and theoretical pattern extraction.

Qualitative Literature Orchestrator

Automates the discovery, retrieval, and organization of academic literature for qualitative research and theoretical pattern extraction.

Zighang Job Scraper

Automates the collection of bookmarked job postings from Zighang and synchronizes them into Obsidian as structured Markdown files.

Gemini Deep Research

Executes autonomous multi-step research and information synthesis using the Google Gemini Deep Research Agent.

Google Custom Search CLI

Integrates Google Programmable Search Engine capabilities directly into Claude Code for programmatic web and image retrieval.

Bright Data Progressive Scraper

Automates web content retrieval using a four-tier escalation strategy to bypass bot detection and CAPTCHAs.

YouTube Video Downloader

Downloads YouTube videos with customizable resolution, format, and audio extraction options via yt-dlp.

Article Content Extractor

Extracts clean, distraction-free text from web articles and blog posts for easy reading and archiving.

YouTube Transcript Downloader

Downloads and processes YouTube video transcripts, captions, and subtitles into clean text or VTT formats.

RSS Feed Fetcher

Fetches and parses RSS feeds from multiple URLs to gather articles for content creation.

Perplexity Search for Claude

Enables Claude to perform AI-powered web searches with real-time information and source citations using Perplexity models.

USPTO Database Connector

Accesses comprehensive USPTO APIs for patent and trademark searches, examination history, and intellectual property analysis.

Fetch Stores

Fetches business listings, store locations, and restaurant details from Google Maps using the Dumpling AI API.

Web API Reverse Engineering

Reverse engineers web applications to discover hidden APIs and automatically generate comprehensive OpenAPI 3.1 specifications.

Article Extractor

Extracts clean, clutter-free content from web articles and blog posts for readable text storage.

Playwright Web Scraper

Implements production-proven Playwright web scraping patterns with a selector-first approach and robust error handling.

Bright Data Progressive Scraper

Automates resilient web content extraction using a four-tier fallback strategy to bypass bot detection and JavaScript hurdles.

Web Browser & Scraper

Enables autonomous web scraping and content extraction using shot-scraper to interact with and retrieve data from websites.

Web Research Assistant

Orchestrates parallel subagents to perform structured, multi-source web investigations and synthesize findings into comprehensive reports.

Brave Web Search & Extraction

Performs headless web searches and extracts clean markdown content using the Brave Search API without requiring a browser.

YouTube Video Downloader

Downloads YouTube videos and audio with customizable quality and format settings using yt-dlp.

YouTube Video Downloader

Downloads YouTube videos and audio with customizable quality and format settings using yt-dlp.

YouTube Transcript Downloader

Downloads, cleans, and polishes YouTube video transcripts and captions into structured markdown files.

Markdown Web Content Fetcher

Optimizes web content retrieval by converting URLs to clean Markdown to reduce token usage by approximately 80%.

Twscrape Twitter Data Collection

Extracts comprehensive data from Twitter/X using GraphQL APIs with robust account rotation and session management.

Perplexity AI Research Tools

Conducts cited web research, technical reporting, and complex reasoning by querying Perplexity AI’s advanced Sonar models.

YouTube Live Segment Downloader

Extracts high-quality video segments from YouTube live streams at up to 30x real-time speed.

YouTube Transcript Extractor

Extracts text transcripts and captions from YouTube videos for analysis, summarization, and offline content processing.