Thunderbit
Automate AI-powered web scraping and structured data extraction with a versatile toolkit including a CLI, MCP server, and Claude Code plugin.
This open-source toolkit provides a comprehensive solution for AI-powered web scraping and structured data extraction, powered by the Thunderbit Open API. It includes a command-line interface for developers and scripts, an MCP server offering seven tools for AI assistants like Claude Desktop and Cursor, and a specialized Claude Code plugin with four bundled skills. Users can convert any web page into clean, LLM-ready Markdown, extract structured data using JSON Schema, get AI-suggested fields when data structure is unknown, and run batch jobs on up to 100 URLs at a time.
主な機能
0112 GitHub stars
02Generate AI-suggested fields for data extraction
03Integrates with AI assistants via Model Context Protocol (MCP) server
04Convert any web page into clean, LLM-ready Markdown
05Extract structured data from web pages using JSON Schema
06Run batch web scraping jobs on up to 100 URLs
ユースケース
01Enriching AI agent capabilities with real-time web data extraction
02Streamlining content conversion from web pages to structured formats
03Automating data collection from websites for analytics or research