Enables AI agents to search the web, news, and fetch web page content, converting it for LLM consumption.
Sponsored
Web Forager is a robust toolkit designed to empower AI agents with advanced search and information retrieval capabilities. It intelligently navigates the web, leveraging DuckDuckGo for general and news searches, and Jina Reader for fetching and converting web pages into LLM-friendly formats like Markdown or JSON. Available as both an MCP server and standalone Agent Skills, it streamlines the process of gathering, processing, and delivering relevant web content for various AI-driven tasks, from research to fact-checking and competitive analysis.
Key Features
014 GitHub stars
02DuckDuckGo web and news search with safe search controls
03Fetch and convert URLs to Markdown or JSON using Jina Reader
04LLM-friendly output format for search results and fetched content
05CLI for direct search, news, fetch, and server commands
06Five standalone Agent Skills for specialized research workflows (e.g., web-research, fact-check)
Use Cases
01Fact-check claims and verify information with evidence from the web
02Automate web research and information gathering for AI agents
03Monitor news and conduct competitive analysis for business intelligence
