NLWeb Retrieval Backend Manager

•
32
•

Configures and manages diverse retrieval backends for NLWeb, enabling seamless integration with vector stores and search engines.

This skill facilitates the selection, configuration, and debugging of various retrieval endpoints within the NLWeb ecosystem, including local Qdrant, cloud-based Azure AI Search, and database extensions like pgvector. It guides developers through the unique 'read-fanout' architecture where queries are executed across multiple enabled backends in parallel while writes are directed to a single canonical store. By providing detailed setup instructions for specific providers and ensuring embedding dimension compatibility, it simplifies the process of building robust, multi-source RAG pipelines for agentic commerce applications.

Key Features

01Automated configuration of config_retrieval.yaml
0232 GitHub stars
03Multi-backend support including Qdrant, Azure, Postgres, and Snowflake
04Step-by-step backend migration and debugging workflows
05Embedding dimension and similarity metric validation
06Parallel read-fanout architecture with automatic URL deduplication

Use Cases

01Migrating site content from local stores to production-grade Azure AI Search
02Hybridizing private database content with live Bing web search results
03Setting up local RAG development environments using file-backed Qdrant