Web Scraping & Data Collection Claudeスキル

YouTube Transcriber

Extracts subtitles and transcripts from YouTube videos directly into local text files using command-line tools or browser automation.

Browser Content Capture

Captures web content from JavaScript-heavy, login-protected, and multi-page sites using the agent-browser CLI.

Browser Content Capture

Captures web content from JavaScript-rendered pages and authenticated sites using the agent-browser CLI.

Documentation Scraper

Transforms documentation websites into structured, categorized reference files optimized for AI context and offline archives.

llms.txt Support

Detects and ingests LLM-optimized documentation via the llms.txt standard to accelerate context gathering for autonomous agents.

Documentation Scraper

Scrapes documentation websites and transforms them into organized, categorized reference files for AI context and offline archives.

Google Places Search & Data

Queries the Google Places API to retrieve detailed location information, reviews, and search results directly within the Claude Code environment.

Z.AI CLI Multi-Tool

Enhances Claude with advanced vision analysis, real-time web searching, and deep GitHub repository exploration capabilities.

Dev Opinions Scan

Aggregates and synthesizes technical opinions and developer reactions from major online communities like Reddit and Hacker News.

Nia - Intelligent Context & Documentation

Indexes and searches external repositories, documentation, and research papers to provide Claude with high-fidelity context for development tasks.

MiniMax Web Search

Enables real-time internet search capabilities using the MiniMax MCP for legal research and general information retrieval.

Exa Semantic Search & Research

Performs high-precision semantic search and structured content retrieval using the Exa AI API for deep research and code documentation.

Grok Search & Real-time Web Retrieval

Powers Claude with real-time web search and deep content extraction via the Grok API to bypass knowledge cutoff limits.

WeChat Article Fetcher

Scrapes and converts WeChat Official Account articles into clean Markdown files with automated image handling and dynamic content support.

Universal Media Downloader

Downloads video and audio content from major platforms like YouTube, Bilibili, and Douyin directly via terminal commands.

Douyin Batch Downloader

Automates bulk downloading of Douyin videos and metadata with incremental update support and data visualization.

Research & Content Access

Provides ethical and legal methodologies for accessing paywalled academic papers, news articles, and geo-restricted content.

Python Data Pipeline Architect

Builds modular, production-grade Python data processing workflows for content scraping, AI analysis, and cloud integration.

Advanced Web Scraping & Extraction

Extracts web content using a multi-tiered cascade architecture that bypasses anti-bot measures and detects paywalls.

Source Verification & Fact-Checking

Implements systematic OSINT and journalism workflows to verify claims, evaluate source credibility, and authenticate digital media.

Web Archiving & Preservation

Automates the preservation and retrieval of web pages using Wayback Machine, Archive.is, and local archiving tools for research and legal evidence.

Newsletter Event Updater

Refreshes specific event pages to synchronize and update event details within a local media database.

Summarize.sh Media Summarizer

Summarizes and extracts content from URLs, YouTube videos, and local files directly within the terminal.

YouTube Transcript Extractor

Downloads and formats YouTube video transcripts with precise timestamps for streamlined content analysis and text extraction.

Domain Research Assistant

Conducts automated domain research and extracts technical requirements using MCP-powered search and documentation tools.

Comprehensive Research Conductor

Performs exhaustive, multi-source research and generates professional-grade documentation with verified citations and deep analysis.

Milan Jovanovic Blog Scraper

Extracts and cleans the latest .NET development articles from Milan Jovanovic's blog with an optimized, cost-effective workflow.

Claude Social Intelligence

Monitors Anthropic and Claude Code social feeds to capture real-time updates and actionable technical insights before official documentation is released.

Batch Documentation Scraper

Automates multi-ecosystem documentation scraping, validation, and maintenance workflows using local development configurations.

Topic Collector

Automates the gathering of AI industry trends, product launches, and developer insights from multiple high-signal web sources.