Web Scraping & Data Collection Agent Skills

bioRxiv Database Search

Searches and retrieves life sciences preprints from the bioRxiv database using keywords, authors, and DOIs.

Browser File Downloader

Enables downloading files from authenticated web sessions by bridging the gap between browser tools and curl commands.

Firecrawl Web & Data Scraper

Powers Claude with superior web searching, high-accuracy scraping, and deep research capabilities using the Firecrawl CLI.

Last 30 Days Research

Researches any topic from the last 30 days across Reddit, X, and the web to deliver real-time insights and copy-paste prompts.

German Telecom EDIFACT Parser

Parses EDIFACT INVOIC files from German telecom providers like Telekom, Vodafone, and O2 to extract billing and contract data.

Video Transcript Extraction

Extracts text transcripts from YouTube, local files, and other video platforms using automated detection and local Whisper AI processing.

Substack Research Toolkit

Extracts and analyzes long-form content from Substack publications to synthesize independent journalist perspectives and expert commentary.

Tavily AI Search

Provides AI-optimized web search results and content extraction using the Tavily API.

YouTube Research & Practitioner Insights

Extracts actionable practitioner knowledge, workflows, and expert tips from YouTube transcripts to supplement formal documentation.

LEV Deep Research Intelligence

Orchestrates multi-layered web research and data synthesis using recursive confidence loops and specialized search engines.

Exa Neural Web Search

Powers Claude with neural, semantic search capabilities to find people, companies, research papers, and GitHub repositories.

Deep Research Diffusion

Conducts exhaustive, multi-perspective research using parallel agent workers and iterative gap detection.

Unified Web Search

Performs simultaneous multi-engine searches using Gemini, Codex, and Claude to provide a consolidated, high-precision information report.

Deep Research Explorer

Automates the discovery and collection of multi-source research data into structured, evidence-based datasets.

YouTube Video Downloader

Downloads YouTube videos and audio with customizable quality, format, and output settings using yt-dlp.

Competitive Ads Extractor

Scrapes and analyzes competitor advertisements from major ad libraries to uncover successful messaging and creative patterns.

Competitive Ads Extractor

Scrapes and analyzes competitor advertisements from major ad libraries to uncover successful messaging, creative patterns, and market positioning.

YouTube Video Downloader

Downloads YouTube videos and audio with customizable quality and format settings directly within Claude Code.

Unified Research

Aggregates data from multiple search APIs like Tavily, SerpAPI, and Perplexity to provide comprehensive, fact-based research summaries.

Competitive Ads Extractor

Extracts and analyzes competitor advertisements from major ad libraries to provide actionable messaging and creative insights.

Mega Research

Conducts comprehensive, multi-source deep-dives and market analysis by integrating six powerful search and AI APIs for citation-backed reporting.

Blog & RSS Monitor

Monitors and manages updates from blogs and RSS/Atom feeds directly through the CLI.

Weather Data Fetcher

Retrieves real-time temperature data from the wttr.in API for specific geographic locations.

Market Research Intelligence

Conducts high-fidelity market research, competitive analysis, and investor due diligence with verified source attribution.

Market Research & Intelligence

Conducts deep market research, competitive analysis, and investor due diligence with source attribution to inform strategic business decisions.

Tavily Web Search

Performs real-time web searches using Tavily's LLM-optimized engine to retrieve filtered snippets, scores, and metadata.

Tavily Web Content Extractor

Extracts clean markdown or text content from specific URLs using the Tavily API without requiring custom scraping scripts.

AI Research Agent

Conducts deep web research with automatic source synthesis, citations, and structured JSON output directly from your terminal.

Web Content Crawler

Crawls websites to extract content into local markdown files or optimized chunks for AI context using the Tavily API.

Web Scraper Data Processor

Processes raw web scraping data into clean, formatted Excel reports with automated statistical analysis and deduplication.