Converts web pages into clean, LLM-ready markdown, automatically bypassing common anti-bot systems like Cloudflare, DataDome, and PerimeterX, all while providing robust SSRF protection.
Sponsored
Stealthfetch is an intelligent web fetching utility designed to convert any web page into clean, LLM-ready markdown format. It automatically handles common anti-bot challenges by first attempting a stealthy HTTP request with Chrome TLS fingerprints, and then escalating to a stealth browser if a block is detected. Beyond its core function of stripping boilerplate content, Stealthfetch prioritizes security with comprehensive SSRF protection, validating URLs both before and after redirects to prevent malicious access to internal networks, making it safe for integration with AI agents.
Key Features
01Automatic anti-bot bypass for Cloudflare, DataDome, and PerimeterX.
02Robust SSRF protection with double-validation of URLs.
03No API key required and available under AGPL-3.0 license.
04Intelligent auto-escalation from HTTP requests to stealth browser.
05Extracts clean, LLM-ready markdown by stripping navigation, ads, and boilerplate.
060 GitHub stars
Use Cases
01Providing secure web access for Large Language Models and AI agents.
02Developing web scraping solutions resilient to common anti-bot measures.
03Automating web content extraction for RAG (Retrieval Augmented Generation) systems.