What is the main difference between SSE and WebSockets in this skill?

SSE is optimized for server-to-client streaming like LLM responses and notifications, while WebSockets are used for full-duplex, bidirectional communication like chat applications.

Why is aclosing() emphasized for Python streaming?

The aclosing() pattern ensures that asynchronous generators are properly closed even if an exception occurs, preventing resource leaks in production environments.

How does the skill handle connection drops?

It includes implementation logic for reconnection strategies, including exponential backoff and handling connection limits for both SSE and WebSockets.

Does this skill help with LLM response streaming?

Yes, it provides specific patterns for streaming ChatGPT-style interfaces using the ReadableStream API and Server-Sent Events.

Streaming API Patterns

Name: Streaming API Patterns
Author: yonatangross

byyonatangross

•

API開発

Implements production-ready real-time data streaming using Server-Sent Events (SSE), WebSockets, and ReadableStream APIs.

This skill provides specialized implementation patterns for building high-performance real-time applications. It focuses on the most common streaming use cases, including LLM token streaming for ChatGPT-style interfaces, live data feeds, and bidirectional communication. The skill covers critical production concerns such as backpressure management, connection lifecycle handling, and resource cleanup—specifically highlighting the aclosing() pattern for Python async generators to prevent memory leaks and dangling connections.

主な機能

01LLM-specific streaming patterns for token-by-token response rendering.

02Exponential backoff reconnection strategies for resilient connections.

03Bidirectional WebSocket patterns for real-time collaboration and chat.

04Python async generator cleanup using the aclosing() context manager.

05Server-Sent Events (SSE) for efficient server-to-client notifications.

0669 GitHub stars

ユースケース

01Developing progress indicators for long-running server-side tasks.

02Building AI chat interfaces with real-time response streaming.

03Creating live financial tickers or real-time analytics dashboards.

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add yonatangross/orchestkit streaming-api-patterns

For use in Claude.ai and ChatGPT

Download Skill