Does it include alerting configuration?

Yes, it provides Prometheus alerting rules for critical conditions such as Under-Replicated Partitions, Offline Partitions, and Controller failures.

Can I use this for Kafka running on Kubernetes?

Yes, it provides specific workflows and configurations for Kubernetes environments, particularly those using the Strimzi Operator and Prometheus Operator.

What specific dashboards are provided?

The skill includes five specific JSON templates: Cluster Overview, Broker Metrics, Consumer Lag, Topic Metrics, and JVM Health.

What monitoring tools does this skill support?

This skill focuses on the industry-standard stack of Prometheus for metrics collection and Grafana for visualization, utilizing the JMX Exporter to bridge Kafka metrics.

How do I install the JMX exporter using this skill?

The skill provides step-by-step commands to download the Java agent, configure the KAFKA_OPTS environment variable, and verify the metrics endpoint.

Kafka Observability Expert

Name: Kafka Observability Expert
Author: anton-abyzov

byanton-abyzov

•

Analytics & Monitoring

Implements comprehensive Kafka monitoring using Prometheus and Grafana to track cluster health, consumer lag, and broker performance.

The Kafka Observability skill provides specialized expertise for implementing production-grade monitoring and observability for Apache Kafka. It offers standardized configurations for Prometheus JMX exporters and provides a suite of five professional Grafana dashboards covering cluster health, broker metrics, consumer lag, topic performance, and JVM internals. Whether you are running Kafka on bare-metal VMs or utilizing Strimzi on Kubernetes, this skill guides you through setup, metric collection, and the creation of critical alerting rules to ensure your event-streaming infrastructure remains healthy and performant.

Key Features

01Pre-configured JMX Exporter mappings for all critical Kafka metrics

02Automated alerting rules for under-replicated partitions and offline controllers

0313 GitHub stars

04Five production-ready Grafana dashboards for comprehensive visualization

05Specialized workflows for both self-hosted and Strimzi-on-Kubernetes deployments

06Detailed guidance for troubleshooting consumer lag and broker bottlenecks

Use Cases

01Setting up a new production monitoring stack for Apache Kafka clusters

02Provisioning Grafana dashboards and Prometheus scrapers via Infrastructure as Code

03Debugging consumer lag and performance issues in real-time

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add anton-abyzov/specweave kafka-observability

For use in Claude.ai and ChatGPT

Download Skill