Web Scraping & Data Collection MCP Servers

Firecrawl

4,195

Empowers LLMs with advanced web scraping capabilities for content extraction, crawling, and search functionalities.

Browserbase

3,112

Enables LLMs to control cloud browsers for web interaction, data extraction, and task automation using Browserbase and Stagehand.

DevDocs

2,022

Crawls, extracts, and organizes technical documentation into an LLM-ready format, streamlining research and implementation for developers.

Mobile Next

3,322

Enables scalable mobile automation through a platform-agnostic interface for interacting with native iOS/Android applications and devices.

GPT Researcher

25,219

Conducts in-depth web and local research on any topic, generating comprehensive reports with citations.

Browser

5,702

Enables AI applications to control a user's existing browser instance.

YouTube Transcript

6,848

Retrieves transcripts and subtitles from YouTube videos, including automatically generated ones, without requiring an API key or headless browser.

Trafilatura

5,281

Extracts text and metadata from web pages and online resources, offering various output formats.

ENScan Go

4,199

Collects and aggregates domestic enterprise information from various sources to aid in reconnaissance tasks.

Crawl4AI RAG

1,988

Empowers AI agents and coding assistants with web crawling and retrieval-augmented generation (RAG) capabilities.

Steel Browser

6,384

Automates web interactions for AI agents and applications without managing infrastructure.

Bright Data

1,990

Empowers AI agents to access, discover, and extract real-time web data, bypassing restrictions and bot detection.

Superglue

1,979

Automates data integration via a stable, self-healing SDK, providing automated schema-drift detection, retries, and remappings to maintain continuous data flow without connector maintenance or rewrites.

Chrome Browser

10,278

Exposes Chrome browser functionality to AI assistants for complex browser automation, content analysis, and semantic search.

XHS Downloader

9,995

Extracts and downloads content from XiaoHongShu (RedNote), including user posts, collections, likes, albums, and search results, while removing watermarks.

Firecrawl

5,415

Integrates powerful web scraping and content extraction capabilities into LLM clients like Cursor and Claude.

Skill Seeker

8,996

Transforms any documentation website into a production-ready Claude AI skill in minutes.

TrendRadar

45,580

Aggregates trending topics from over 35 platforms, offering intelligent filtering, automated multi-channel notifications, and AI-powered conversational analysis for deep news insights.

Playwriter

2,731

Enables AI agents to control web browsers via a Chrome extension, offering full Playwright API access with minimal context overhead.

DDGS

2,145

Aggregates search results from various web search services through a unified metasearch library.