Web Scraping & Data Collection Claude 技能

Interview Ingest

Converts interview recordings, academic PDFs, and various document formats into structured markdown for qualitative analysis.

Video Downloader

Downloads high-quality videos and audio from YouTube and other platforms for offline viewing, archiving, and editing.

Tavily Web Search

Conducts real-time, AI-optimized web searches and content extraction to provide up-to-date information beyond Claude's knowledge cutoff.

Blog Profile Analyzer

Analyzes blogs and online publications to extract deep insights into author perspectives, political leanings, and hidden biases.

Automated Video Parser & Downloader

Automates video metadata extraction and file downloading by processing task lists through MCP services.

Daily Competition Scout

Automates the entire end-to-end competition management workflow from discovery and analysis to entry drafting and notification.

Web Scraping & Content Extraction Tools

Automates documentation collection and structured data extraction using Playwright, BeautifulSoup, and Scrapy templates.

Zhipu AI Search

Performs intelligent web searches via the Zhipu search engine with automated relative date resolution.

YouTube Info MCP Installer

Installs and configures the YouTube Info MCP server to enable automated extraction of video metadata and details within Claude Code.

Pure.md MCP Installer

Automates the installation and configuration of the Pure.md MCP server for seamless web-to-markdown conversion within Claude Code.

Image Extraction

Extracts and correlates high-quality food images from delivery platforms and restaurant websites to populate digital catalogs and menus.

YouTube Transcript Downloader

Downloads and processes YouTube video transcripts in bulk from CSV files or individual URLs into structured Markdown format.

Gemini Google Search Tool

Integrates Gemini AI models with real-time web content through Google Search grounding to provide verified information and automatic citations.

PDF to Markdown Converter

Converts entire PDF documents into clean, structured Markdown while preserving formatting, tables, and images for seamless context loading.

AI Tech Digest

Curates specialized AI technology news and technical insights using targeted search strategies and quality filtering rules.

Actress Classifier Development Guide

Streamlines the development of Python-based video classification systems with optimized scraping and incremental database management.

YT-DLP Video Downloader

Downloads audio and video from thousands of websites with advanced control over formats, subtitles, and metadata.

Crawl4AI

Crawls entire websites and extracts clean, structured content into markdown files with AI-enriched metadata.

Competition Scraper & GitHub Persister

Scrapes Australian creative writing competitions and automatically manages them as structured GitHub issues with intelligent duplicate detection.

Advanced Video Downloader

Downloads high-quality videos and extracts audio from over 1000 platforms including YouTube, Bilibili, and TikTok using yt-dlp.

Web Connectivity and Search

Searches the internet and converts live webpage content into markdown for real-time information retrieval and analysis.

Competitive Ads Extractor

Extracts and analyzes competitor advertisements from major ad libraries to uncover successful messaging patterns and creative strategies.

XML Element Extractor

Isolates specific XML elements from large source files while maintaining structural integrity and formatting.

Advanced Research Assistant

Conducts exhaustive, discovery-driven research using parallel LLM agents and multi-source synthesis to deliver cited, high-confidence reports.

YouTube Transcript Downloader

Extracts and converts YouTube transcripts or auto-generated captions into clean, readable text files.

Web Content Fetcher

Scrapes web pages and WeChat articles to produce clean, noise-free Markdown content for processing, translation, or archival.

Web Search

Performs structured web searches via DuckDuckGo to retrieve real-time documentation, library information, and technical solutions.

Web Crawler & Search Indexer

Crawls entire websites and builds searchable full-text indexes of content converted into Markdown format.

Wget URL Reader

Fetches and downloads content from any URL using the powerful wget command-line utility.

YouTube Video to Audio

Downloads and converts YouTube videos into high-quality audio files using yt-dlp and ffmpeg.