Web Scraping & Data Collection Agent Skills

YouTube Transcript Downloader

Extracts and converts YouTube video transcripts into clean, readable text files directly within the terminal.

Video Downloader

Downloads high-quality video and audio content from YouTube and other platforms for offline viewing, editing, or archival.

Firecrawl API

Extracts clean web content, crawls entire domains, and searches the web directly through the Firecrawl API using terminal commands.

Firecrawl Web Scraping

Scrapes web content, maps site structures, and extracts structured data using advanced crawling and search capabilities.

Perplexity Research

Integrates the Perplexity API to conduct deep web research, capture real-time data, and generate structured reports with verifiable citations.

AI-Powered PDF Text Extractor

Converts PDF documents into LLM-friendly Markdown while preserving complex structures like tables, headers, and lists.

Person Intelligence Analyzer

Performs deep multi-platform intelligence gathering across LinkedIn, X, Reddit, and GitHub to create actionable networking and sales reports.

Meta Searching

Overcomes access restrictions, rate limits, and validation errors to perform reliable web searches and content extraction when standard tools fail.

Universal Deep Search

Conducts comprehensive cross-platform intelligence gathering with automated cascading research for people, companies, and topics.

Search Plus

Overcomes web access restrictions and rate limits by performing federated searches and intelligent content extraction from blocked or challenging URLs.

Competitor Analyzer

Performs deep competitive intelligence by synthesizing data from web scraping, social media, and executive leadership profiles.

Multi-Source Investigation

Conducts systematic, high-integrity research across diverse information sources with rigorous cross-validation and credibility scoring.

Crawl4AI

Scrapes websites, extracts structured data, and automates web data collection pipelines using the Crawl4AI library.

Extracting Form Fields

Extracts and structures metadata from PDF form fields into JSON format to facilitate automated document processing and form filling.

X Content Extraction and Script Generation

Extracts Twitter posts and comments to organize viewpoints and generate professional narration scripts for content production.

YouTube Transcript

Extracts YouTube video transcripts, metadata, and chapters into formatted Markdown files for knowledge management systems.

Scientific PDF Data Extraction

Extracts and validates structured data from scientific literature collections to create analysis-ready datasets for systematic reviews and meta-analyses.

Web Search Optimizer

Performs intelligent web searches using a prioritized MCP strategy to find the most relevant documentation and live technical data.

Advanced Gemini Web Search

Executes comprehensive web searches using the Gemini command to gather real-time data and detailed information.

LangChain Deep Research

Conducts deep, iterative web research to generate comprehensive reports with verified citations and source tracking.

Verified Research

Conducts deep-dive technical research by verifying actual source content across GitHub repositories and web documentation.

Video Downloader

Downloads videos and playlists from YouTube and other platforms in various resolutions and formats for offline viewing and archival.

Investigative Journalism Researcher

Conducts deep investigative research and source verification for documentary-style creative projects and journalism.

Legal Research Specialist

Extracts narrative-rich facts, quotes, and timelines from court documents and indictments for documentary and creative projects.

Official Government Source Researcher

Researches and extracts factual data from official US government agency statements, press releases, and litigation records.

Investigative Researcher

Performs journalism-grade investigative research using primary source analysis, triple-source verification, and evidence-chain mapping.

Financial Research Specialist

Analyzes SEC filings, earnings calls, and market data to extract deep corporate insights and financial narratives.

Biographical Researcher for Music

Conducts deep biographical research to extract humanizing details, quotes, and life trajectories for documentary-style music production.

Automated Document Hunter

Automates the systematic search, retrieval, and organization of primary source documents from free public archives using browser automation.

Primary Source Researcher

Identifies and captures a subject's authentic voice from social media, blogs, and archives for documentary music projects.