Does it cover exactly-once semantics (EOS)?

Yes, it includes specific broker and producer configuration templates required to support transactional workloads and atomic stream processing.

Does this skill help with KRaft migration?

Yes, it provides configuration patterns and architectural guidance for migrating from legacy ZooKeeper to KRaft mode in Kafka 3.3+.

Is it useful for small development or testing clusters?

Yes, it provides scaled-down hardware recommendations and configuration templates specifically for dev/test environments and proof-of-concepts.

How does it handle multi-datacenter architecture?

It offers patterns for both active-passive and active-active architectures, including guidance on MirrorMaker 2 and geo-replication conflict resolution.

Can it calculate how many partitions I need for a specific topic?

Absolutely. It uses target throughput, read/write requirements, and consumer parallelism formulas to recommend optimal partition counts.

Kafka Architecture & Design Expert

Name: Kafka Architecture & Design Expert
Author: anton-abyzov

byanton-abyzov

•

Cloud Infrastructure

Provides expert guidance on Apache Kafka cluster design, capacity planning, and high-availability strategies for resilient event streaming.

About

This skill equips Claude with deep technical expertise in Apache Kafka architecture, enabling it to assist with complex infrastructure decisions and system design. It covers the full spectrum of Kafka management, from partition strategies and replication factors to KRaft migration and multi-datacenter patterns. Whether you are sizing a new production cluster, optimizing broker performance, or implementing exactly-once semantics, this skill provides the implementation patterns and best practices needed to build scalable, fault-tolerant, and high-performance event-driven systems.

Key Features

Detailed cluster sizing guidelines for small, medium, and large-scale workloads
Advanced performance tuning for brokers, producers, and consumers
High availability configurations including rack awareness and ISR management
13 GitHub stars
Strategic partition design and key selection for balanced data distribution
Migration patterns and configuration for KRaft and legacy ZooKeeper modes

Use Cases

Architecting a new high-throughput event streaming platform with specific scalability requirements
Optimizing existing Kafka clusters to resolve performance bottlenecks and latency issues
Designing disaster recovery and geo-replication patterns for mission-critical multi-region deployments

About

Key Features

Detailed cluster sizing guidelines for small, medium, and large-scale workloads
Advanced performance tuning for brokers, producers, and consumers
High availability configurations including rack awareness and ISR management
13 GitHub stars
Strategic partition design and key selection for balanced data distribution
Migration patterns and configuration for KRaft and legacy ZooKeeper modes

Use Cases

Architecting a new high-throughput event streaming platform with specific scalability requirements
Optimizing existing Kafka clusters to resolve performance bottlenecks and latency issues
Designing disaster recovery and geo-replication patterns for mission-critical multi-region deployments