Stealthfetch

关于

Stealthfetch is an intelligent web fetching utility designed to convert any web page into clean, LLM-ready markdown format. It automatically handles common anti-bot challenges by first attempting a stealthy HTTP request with Chrome TLS fingerprints, and then escalating to a stealth browser if a block is detected. Beyond its core function of stripping boilerplate content, Stealthfetch prioritizes security with comprehensive SSRF protection, validating URLs both before and after redirects to prevent malicious access to internal networks, making it safe for integration with AI agents.

主要功能

• Automatic anti-bot bypass for Cloudflare, DataDome, and PerimeterX.
• Robust SSRF protection with double-validation of URLs.
• No API key required and available under AGPL-3.0 license.
• Intelligent auto-escalation from HTTP requests to stealth browser.
• Extracts clean, LLM-ready markdown by stripping navigation, ads, and boilerplate.
• 0 GitHub stars

使用案例

• Providing secure web access for Large Language Models and AI agents.
• Developing web scraping solutions resilient to common anti-bot measures.
• Automating web content extraction for RAG (Retrieval Augmented Generation) systems.