Web Scraping & Data Collection Agent Skills

TripIt Data Exporter

Exports comprehensive TripIt travel data including trips, flights, and lodging into a structured JSON format via browser automation.

RSS Reader & Feed Parser

Parses and monitors RSS/Atom feeds to extract structured updates from news sites, blogs, and social platforms.

Video Subtitle Extractor

Extracts and cleans transcripts from global video platforms like YouTube and Bilibili into readable text files.

VeyraX MCP Installer

Automates the installation and configuration of the VeyraX MCP server for enhanced web search and content extraction.

Competitive Ads Extractor

Extracts and analyzes competitor advertisements from major ad libraries to uncover successful messaging patterns and creative strategies.

Advanced Video Downloader

Downloads high-quality videos and extracts audio from over 1000 platforms including YouTube, Bilibili, and TikTok using yt-dlp.

YouTube Transcript Downloader

Extracts and converts YouTube transcripts or auto-generated captions into clean, readable text files.

Video Downloader

Downloads high-quality video and audio content from YouTube and other platforms directly through the Claude Code interface.

Article Extractor

Extracts clean, readable text from URLs by stripping away ads, navigation menus, and web clutter.

Advanced Research Assistant

Conducts exhaustive, discovery-driven research using parallel LLM agents and multi-source synthesis to deliver cited, high-confidence reports.

Daily Competition Scout

Automates the entire end-to-end competition management workflow from discovery and analysis to entry drafting and notification.

Web Search & Summarizer

Performs focused web searches to retrieve and summarize real-time information from authoritative sources.

Unified Research

Aggregates data from multiple search APIs like Tavily, SerpAPI, and Perplexity to provide comprehensive, fact-based research summaries.

Deep Research Explorer

Automates the discovery and collection of multi-source research data into structured, evidence-based datasets.

Mega Research

Conducts comprehensive, multi-source deep-dives and market analysis by integrating six powerful search and AI APIs for citation-backed reporting.

Deep Research Agent

Conducts automated deep-dive research by searching the web, analyzing sources, and generating structured reports with citations.

GPT Researcher

Conducts autonomous deep research by exploring hundreds of web sources to generate comprehensive, citation-backed reports.

Research Free

Conducts comprehensive web research and generates detailed reports without requiring external search API keys.

Exa Semantic Search

Conducts semantic web searches and discovers similar content using the Exa AI-powered search engine.

YouTube & Video Downloader

Downloads videos, audio, and subtitles from YouTube and other platforms using yt-dlp with optimized settings.

Twitter/X Media Downloader

Downloads high-quality images and videos from Twitter/X using automated gallery-dl workflows.

Google Places Search

Queries the Google Places API to search for locations, retrieve place details, and fetch reviews directly within the terminal.

Google Places Search

Integrates Google Places API into your workflow for searching locations, retrieving business details, and analyzing reviews.

Firecrawl Web Scraper

Converts complex websites into LLM-ready markdown or structured data with advanced anti-bot bypass and autonomous AI navigation.

RFP Data Ingestion Engine

Automates the collection, normalization, and deduplication of Request for Proposal (RFP) opportunities from government and private data sources.

Twitter Thread Extractor

Extracts and converts Twitter/X threads into clean, well-formatted markdown files using automated browser interaction.

Webpage Summarizer & Markdown Generator

Extracts web content from static and dynamic sites and transforms it into structured, high-quality Markdown documentation.

Exa Semantic Search

Powers Claude with neural search capabilities to find similar content and structured data using the Exa API.