Transforms any webpage into clean, AI-ready markdown by intelligently escalating from fast HTTP fetches to robust headless browser rendering.
Sponsored
WebPeel is a powerful web content fetcher designed to provide AI agents with clean, optimized data from any webpage. It employs a smart escalation mechanism, attempting the fastest HTTP fetch first and only engaging a headless browser (Playwright) for JavaScript-heavy or protected sites, saving resources and increasing efficiency. The tool outputs content as AI-optimized markdown, complete with metadata and token counts. It offers a zero-config CLI for local, free usage, a TypeScript library for programmatic access, and includes a built-in MCP server for seamless integration with AI agents like Claude Desktop, Cursor, and VS Code.
Características Principales
010 GitHub stars
02Smart Escalation from HTTP to Headless Browser
03AI-Optimized Markdown Output with Metadata and Token Count
04Free Local Execution with Zero Config CLI
05Built-in MCP Server for Claude, Cursor, and VS Code
06Automatic Anti-bot Handling and Cloudflare Bypass
Casos de Uso
01Feed web content to AI agents like Claude or GPT
02Bulk extract articles, documentation, or social media for research
03Monitor websites for content changes or archive web pages as clean markdown