Can I use this skill for bulk document ingestion?

Yes, the skill includes specific logic and patterns for batching documents into groups of 100 and spacing requests to stay within the recommended bulk-request-per-minute limits.

How does this skill handle 429 Too Many Requests errors?

It provides a robust retry strategy that parses the 'Retry-After' header, applies exponential backoff, and adds random jitter to prevent repeated collisions.

What are the primary rate limits for Glean's Indexing API?

The Indexing API generally allows approximately 100 requests per minute for single documents, or 20 requests per minute for bulk uploads (up to 100 documents per request).

What is the limit for Glean search queries?

Search queries are typically capped at 60 requests per minute per API token. This skill provides a search-specific limiter to manage this threshold.

How do I handle a 413 Payload Too Large error in Glean?

The skill suggests splitting the batch into smaller segments if the payload exceeds 100 documents or 10MB, which are the standard limits for the Glean Indexing API.

Glean API Rate Limit Optimizer

Name: Glean API Rate Limit Optimizer
Author: jeremylongshore

byjeremylongshore

•

2,083

•

API開発

Manages Glean Indexing and Client API rate limits with robust retry strategies and batch processing patterns.

The Glean Rate Limits skill provides developers with essential guidance and implementation patterns for interacting with Glean's enterprise search APIs without triggering 429 errors. It defines specific thresholds for the Indexing API (100 req/min) and Client Search API (60 req/min), offering production-ready TypeScript implementations for token-bucket rate limiters and exponential backoff retry logic. This skill is critical for developers building data connectors or search interfaces that need to synchronize large-scale knowledge bases from platforms like Confluence or Notion into the Glean search corpus.

主な機能

01Detailed error handling guide for common API responses like 429 and 413

02Comprehensive rate limit reference for Indexing, Search, and People APIs

03Bulk indexing templates for managing 100-document batch uploads

04TypeScript-based rate limiter implementation with token bucket logic

05Intelligent retry strategies featuring exponential backoff and jitter

062,083 GitHub stars

ユースケース

01Building resilient search clients that gracefully handle high-concurrency query traffic

02Synchronizing 100K+ documents from internal wikis into Glean without pipeline stalls

03Implementing automated data ingestion pipelines with reliable 429 error recovery

主な機能

01Detailed error handling guide for common API responses like 429 and 413

02Comprehensive rate limit reference for Indexing, Search, and People APIs

03Bulk indexing templates for managing 100-document batch uploads

04TypeScript-based rate limiter implementation with token bucket logic

05Intelligent retry strategies featuring exponential backoff and jitter

062,083 GitHub stars

ユースケース

01Building resilient search clients that gracefully handle high-concurrency query traffic

02Synchronizing 100K+ documents from internal wikis into Glean without pipeline stalls

03Implementing automated data ingestion pipelines with reliable 429 error recovery