Does it provide guidance on handling out-of-order events?

It includes strategies for watermarking and 'allowed lateness' to help systems decide when a time window is complete even when data arrives late.

Can it assist with data consistency and exactly-once semantics?

Yes, it covers the technical patterns required for idempotent operations and transactional processing to ensure no data is lost or duplicated.

How does this skill help with framework selection?

It provides a detailed comparison between Kafka Streams, Apache Flink, and Spark Streaming based on latency, state management, and deployment complexity.

Is this skill useful for designing microservices?

Absolutely. It focuses on event-driven patterns and stream-table joins that are fundamental to modern, scalable microservice architectures.

Stream Processing Systems Design

Name: Stream Processing Systems Design
Author: melodic-software

bymelodic-software

•

Cloud Infrastructure

Architects real-time data pipelines and event-driven systems using industry-standard streaming frameworks and patterns.

This skill empowers Claude to design, implement, and optimize real-time data processing architectures by providing deep technical guidance on choosing between frameworks like Apache Kafka Streams, Flink, and Spark Streaming. It covers critical concepts such as event-time vs. processing-time, watermarking, and windowing strategies to ensure data integrity in unbounded streams. Users can leverage this skill to build robust stateful applications, handle late-arriving data, and implement complex event delivery guarantees like exactly-once semantics for production-grade systems.

Key Features

01Advanced windowing strategies (Tumbling, Sliding, Session)

02Late event handling and watermark implementation

0312 GitHub stars

04Framework comparison for Kafka Streams, Flink, and Spark

05State management and fault-tolerant processing patterns

06Event delivery guarantees and deduplication logic

Use Cases

01Designing high-throughput, low-latency data pipelines for real-time analytics

02Implementing exactly-once semantics for financial and transactional event systems

03Migrating batch-oriented processing to modern event-driven architectures

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add melodic-software/claude-code-plugins stream-processing

For use in Claude.ai and ChatGPT

Download Skill