Web Scraping & Data Collection Agent Skills

LinkedIn Resume & Job Optimizer

Automates LinkedIn job searching and generates ATS-optimized resumes with integrated skill gap analysis and interview preparation.

XLSForm Designer

Simplifies the creation of standardized data collection forms in Excel for mobile survey platforms like ODK and KoBoToolbox.

Web Scraper Quality Assurance

Enforces a rigorous, test-driven development workflow for building and maintaining web scrapers and data extraction agents.

Web Content Fetcher

Scrapes web pages and WeChat articles to produce clean, noise-free Markdown content for processing, translation, or archival.

XML Element Extractor

Isolates specific XML elements from large source files while maintaining structural integrity and formatting.

Image Extraction

Extracts and correlates high-quality food images from delivery platforms and restaurant websites to populate digital catalogs and menus.

Gemini Google Search Tool

Integrates Gemini AI models with real-time web content through Google Search grounding to provide verified information and automatic citations.

PDF to Markdown Converter

Converts entire PDF documents into clean, structured Markdown while preserving formatting, tables, and images for seamless context loading.

Web Reference Fetcher

Fetches web documentation, extracts specific topics using AI subagents, and generates structured markdown summaries.

Web Scraper

Performs concurrent, recursive web scraping to extract clean text content while maintaining URL-based directory structures and respecting domain boundaries.

Literature Sweep

Orchestrates the discovery, retrieval, and organization of academic literature to facilitate theoretical pattern extraction and qualitative research synthesis.

Interview Ingest

Converts interview recordings, academic PDFs, and various document formats into structured markdown for qualitative analysis.

Web Research Assistant

Orchestrates systematic web research through automated planning, parallel subagent delegation, and comprehensive report synthesis.

Structured Web Research

Conducts systematic web research by planning subtasks, delegating to research agents, and synthesizing findings into comprehensive reports.

AI Research Collector

Aggregates and preprocesses high-quality AI programming tips and best practices from major developer platforms.

TripIt Data Exporter

Exports comprehensive TripIt travel data including trips, flights, and lodging into a structured JSON format via browser automation.

RSS Reader & Feed Parser

Parses and monitors RSS/Atom feeds to extract structured updates from news sites, blogs, and social platforms.

Competitive Ads Extractor

Extracts and analyzes competitor advertisements from major ad libraries to uncover successful messaging patterns and creative strategies.

Advanced Video Downloader

Downloads high-quality videos and extracts audio from over 1000 platforms including YouTube, Bilibili, and TikTok using yt-dlp.

YouTube Transcript Downloader

Extracts and converts YouTube transcripts or auto-generated captions into clean, readable text files.

Video Downloader

Downloads high-quality video and audio content from YouTube and other platforms directly through the Claude Code interface.

YouTube & Video Downloader

Downloads videos, audio, and subtitles from YouTube and other platforms using yt-dlp with optimized settings.

Twitter/X Media Downloader

Downloads high-quality images and videos from Twitter/X using automated gallery-dl workflows.

Google Places Search

Queries the Google Places API to search for locations, retrieve place details, and fetch reviews directly within the terminal.

Google Places Search

Integrates Google Places API into your workflow for searching locations, retrieving business details, and analyzing reviews.

RFP Data Ingestion Engine

Automates the collection, normalization, and deduplication of Request for Proposal (RFP) opportunities from government and private data sources.

bioRxiv Preprint Search

Accesses and retrieves research papers from the bioRxiv preprint server for literature reviews and trend analysis.

Smart Link Extractor

Extracts core resources from social media and technical blogs to generate structured Markdown archives with intelligent categorization.

Scraper Code Generator

Generates high-performance, robust Python code for scraping and parsing structured API documentation from HTML.

Doc Site Analysis

Analyzes API documentation structures to identify data extraction patterns for automated scraper generation.