Fetch-Save
0
Retrieves web content as Markdown and saves it to a local file.
About
Fetch-Save empowers LLMs to retrieve content from web pages, convert HTML to Markdown for simplified consumption, and persistently store the retrieved content in a local file. Unlike standard fetch servers, this tool offers a 'fetch-save' function, enabling both content retrieval and local storage for future access or processing.
Key Features
- Option to ignore robots.txt
- Saves fetched content to a local file
- Supports configuration for proxy and user-agent
- Fetches content from URLs
- 0 GitHub stars
- Converts HTML to Markdown
Use Cases
- Creating a local archive of web content for offline access
- Preparing web content for ingestion into LLMs
- Automating the process of web scraping and saving data
Sponsored