Better Fetch FAQs

Question 1

What is Better Fetch?

Accepted Answer

Better Fetch is a tool that intelligently fetches and processes web content, transforming documentation sites and web resources into structured markdown files, optimized for AI consumption and analysis.

Question 2

What are the main features of Better Fetch?

Accepted Answer

Key features include smart web crawling with configurable depth, intelligent content processing and cleaning, advanced markdown generation with link preservation, respectful crawling with built-in delays, and flexible configuration options.

Question 3

What can I use Better Fetch for?

Accepted Answer

Better Fetch is ideal for documentation processing, content analysis & research, creating AI training data, building knowledge bases, and preparing content for Retrieval-Augmented Generation (RAG) systems.

Question 4

How do I configure the crawl depth and page limits?

Accepted Answer

You can configure the crawl depth and page limits using the `maxDepth` and `maxPages` parameters in the `fetch_website_nested` tool.  The defaults are 2 for depth and 50 for pages, but they are easily customizable based on your needs.

Question 5

Is Better Fetch respectful to websites when crawling?

Accepted Answer

Yes, Better Fetch includes built-in delays between requests to ensure respectful crawling and avoid overloading target websites.  This helps prevent your crawling activity from being flagged as malicious.

Better Fetch

About

Key Features

Use Cases