Fetches and extracts text content from web pages and APIs, functioning as a standalone CLI tool or an MCP server.
Web Curl is a versatile tool designed for extracting text-based content from websites and APIs. It can operate as a command-line interface (CLI) tool or as an MCP (Model Context Protocol) server, offering flexibility in its application. Leveraging Puppeteer for web scraping, it supports features like resource blocking, custom headers, and authentication. It also integrates with the Google Custom Search API, allowing for comprehensive web searches and data retrieval. The tool is built with Node.js and TypeScript and is suitable for various tasks requiring web content extraction and API interaction.