Playwright Fetch
Enables LLMs to fetch and process JavaScript-rendered web content, converting HTML to markdown for easier consumption.
소개
Playwright Fetch is a Model Context Protocol (MCP) server designed to provide web content fetching capabilities through Playwright, a powerful browser automation tool. It allows Large Language Models (LLMs) to retrieve and process content from web pages, even those heavily reliant on JavaScript rendering. The server extracts the main content areas from web pages and converts the HTML into clean, readable markdown, making it easier for LLMs to understand and utilize the information. With features like pagination support, robots.txt compliance, and proxy support, Playwright Fetch offers a robust solution for integrating dynamic web content into LLM workflows.
주요 기능
- Renders web pages with full JavaScript support using Playwright.
- 0 GitHub stars
- Complies with robots.txt directives for ethical web scraping.
- Automatically identifies and extracts main content areas.
- Converts HTML to clean, readable markdown.
- Supports proxy servers for flexible network configurations.
사용 사례
- Enhancing LLM knowledge bases with up-to-date web content.
- Automating data extraction from dynamic web pages.
- Enabling LLMs to interact with JavaScript-heavy web applications.
