Web Scraping & Data Collection MCP Servers

Discover our curated collection of MCP servers for web scraping & data collection. Browse 547 servers and find the perfect MCPs for your needs.

GPT Researcher icon

GPT Researcher

21,420

Conducts in-depth web and local research on any topic, generating comprehensive reports with citations.

Skyvern icon

Skyvern

13,372

Automates browser-based workflows using LLMs and computer vision for robust and adaptable web interactions.

Trafilatura icon

Trafilatura

4,249

Extracts text and metadata from web pages and online resources, offering various output formats.

YouTube Transcript icon

YouTube Transcript

3,902

Retrieves transcripts and subtitles from YouTube videos, including automatically generated ones, without requiring an API key or headless browser.

ENScan Go icon

ENScan Go

3,618

Collects and aggregates domestic enterprise information from various sources to aid in reconnaissance tasks.

Firecrawl icon

Firecrawl

3,125

Empowers LLMs with advanced web scraping capabilities for content extraction, crawling, and search functionalities.

Browserbase icon

Browserbase

1,675

Enables LLMs to control cloud browsers for web interaction, data extraction, and task automation using Browserbase and Stagehand.

Agent Twitter Client icon

Agent Twitter Client

1,652

Automates interactions with Twitter, including scraping data, sending tweets, and engaging with Grok AI, all without needing the official Twitter API.

Browser icon

Browser

1,538

Enables AI applications to control a user's existing browser instance.

DevDocs icon

DevDocs

1,518

Crawls, extracts, and organizes technical documentation into an LLM-ready format, streamlining research and implementation for developers.

Zenfeed icon

Zenfeed

836

Empowers RSS with AI to automatically filter, summarize, and deliver important information, reducing information overload.

Notte icon

Notte

741

Enables the development, deployment, and scaling of web browsing agents through a single API.

Fetcher icon

Fetcher

682

Fetches web page content using a Playwright headless browser, enabling JavaScript execution and intelligent content extraction.

Mobile Next icon

Mobile Next

632

Enables scalable mobile automation through a platform-agnostic interface for interacting with native iOS/Android applications and devices.

RedNote icon

RedNote

473

Access content from the RedNote (XiaoHongShu) platform via an MCP server.

Crawl4AI RAG icon

Crawl4AI RAG

451

Empowers AI agents and coding assistants with web crawling and retrieval-augmented generation (RAG) capabilities.

Deepwiki icon

Deepwiki

430

Fetches and converts Deepwiki content to Markdown for use in code editors and other MCP-compatible clients.

Tavily icon

Tavily

384

Integrates Tavily's search and data extraction capabilities with AI assistants via the Model Context Protocol.

Fetch icon

Fetch

375

Fetches and transforms web content into various formats.

YouTube icon

YouTube

336

Downloads YouTube subtitles using yt-dlp and connects to claude.ai via Model Context Protocol.

Scroll for more results...