Does this skill provide code for specific programming languages?

Yes, it includes detailed implementation patterns and code examples for TypeScript (Node.js), Python, Go, and Java/Scala.

What delivery guarantees does the skill help implement?

It provides configuration guidance for various delivery semantics, including At-Most-Once, At-Least-Once, and complex Exactly-Once transactional processing.

Which message brokers are supported by this skill?

The skill covers major brokers including Apache Kafka, Redpanda, Apache Pulsar, and RabbitMQ, providing specific decision frameworks for choosing the right one for your needs.

Can I use this for Change Data Capture (CDC)?

Absolutely. The skill includes dedicated patterns for CDC using tools like Debezium to synchronize database changes into your event streams in real-time.

Does it support stream processing frameworks?

Yes, it includes architectural comparisons and setup guides for Apache Flink, Apache Spark Streaming, Kafka Streams, and ksqlDB.

Streaming Data & Event-Driven Systems

Name: Streaming Data & Event-Driven Systems
Author: ancoleman

byancoleman

•

158

•

Database Management

Builds production-ready event streaming systems and real-time data pipelines using modern brokers like Kafka, Redpanda, and Pulsar.

This skill empowers developers to architect and implement robust streaming data solutions, ranging from event-driven microservices to real-time analytics pipelines. It provides domain-specific guidance on choosing the right message brokers and stream processors (such as Flink and Spark), while offering implementation patterns for producer/consumer logic, Change Data Capture (CDC), and event sourcing across TypeScript, Python, Go, and Java. Whether managing delivery guarantees or implementing complex event processing, this skill ensures best practices for performance, durability, and scalability in high-throughput environments.

Key Features

01End-to-end stream processing patterns with Flink, Spark, and ksqlDB

02Production-grade error handling, DLQs, and exactly-once processing strategies

03158 GitHub stars

04Advanced architectural patterns including Event Sourcing and CDC

05Multi-broker support for Apache Kafka, Redpanda, and Apache Pulsar

06Language-specific implementations for Node.js, Python, Go, and Java

Use Cases

01Implementing event-driven microservices communication and state management

02Building real-time analytics, monitoring, and alerting dashboards

03Creating high-throughput data integration and automated ETL/ELT pipelines

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add ancoleman/ai-design-components streaming-data

For use in Claude.ai and ChatGPT

Download Skill