Web Scraping & Data Collection MCP Servers

GPT Researcher

23,955

Conducts in-depth web and local research on any topic, generating comprehensive reports with citations.

XHS Downloader

9,024

Extracts and downloads content from XiaoHongShu (RedNote), including user posts, collections, likes, albums, and search results, while removing watermarks.

Chrome Browser

9,005

Exposes Chrome browser functionality to AI assistants for complex browser automation, content analysis, and semantic search.

YouTube Transcript

6,355

Retrieves transcripts and subtitles from YouTube videos, including automatically generated ones, without requiring an API key or headless browser.

Steel Browser

5,854

Automates web interactions for AI agents and applications without managing infrastructure.

Trafilatura

4,836

Extracts text and metadata from web pages and online resources, offering various output formats.

Firecrawl

4,801

Integrates powerful web scraping and content extraction capabilities into LLM clients like Cursor and Claude.

Browser

4,735

Enables AI applications to control a user's existing browser instance.

TrendRadar

4,671

Aggregates trending topics from over 35 platforms, offering intelligent filtering, automated multi-channel notifications, and AI-powered conversational analysis for deep news insights.

Firecrawl

4,195

Empowers LLMs with advanced web scraping capabilities for content extraction, crawling, and search functionalities.

ENScan Go

3,985

Collects and aggregates domestic enterprise information from various sources to aid in reconnaissance tasks.

Browserbase

2,751

Enables LLMs to control cloud browsers for web interaction, data extraction, and task automation using Browserbase and Stagehand.

Mobile Next

2,314

Enables scalable mobile automation through a platform-agnostic interface for interacting with native iOS/Android applications and devices.

Skill Seeker

2,234

Transforms any documentation website into a production-ready Claude AI skill in minutes.

DevDocs

1,941

Crawls, extracts, and organizes technical documentation into an LLM-ready format, streamlining research and implementation for developers.

Superglue

1,917

Automates data integration via a stable, self-healing SDK, providing automated schema-drift detection, retries, and remappings to maintain continuous data flow without connector maintenance or rewrites.

Crawl4AI RAG

1,801

Empowers AI agents and coding assistants with web crawling and retrieval-augmented generation (RAG) capabilities.

OpenDia

1,698

Exposes comprehensive browser functions via the Model Context Protocol, enabling external applications and AI models to programmatically interact with a web browser.

Agent Twitter Client

1,689

Automates interactions with Twitter, including scraping data, sending tweets, and engaging with Grok AI, all without needing the official Twitter API.

Notte

1,651

Enables the development, deployment, and scaling of web browsing agents through a single API.