Web Curl
Fetches and extracts text content from web pages and APIs, functioning as a standalone CLI tool or an MCP server.
Acerca de
Web Curl is a versatile tool designed for extracting text-based content from websites and APIs. It can operate as a command-line interface (CLI) tool or as an MCP (Model Context Protocol) server, offering flexibility in its application. Leveraging Puppeteer for web scraping, it supports features like resource blocking, custom headers, and authentication. It also integrates with the Google Custom Search API, allowing for comprehensive web searches and data retrieval. The tool is built with Node.js and TypeScript and is suitable for various tasks requiring web content extraction and API interaction.
Características Principales
- Functions as a CLI tool or as an MCP server
- Integrates with Google Custom Search API
- Retrieves text content from any website
- 2 GitHub stars
- Blocks unnecessary resources for faster loading
- Makes REST API requests with custom methods and headers
Casos de Uso
- API data retrieval
- Web scraping for data collection
- Integration with Roo Code or other MCP-compatible platforms
Sponsored