What data stacks does this skill support?

It is optimized for SQL (MySQL, Data Warehouses), Kafka streaming, Python/Java pipeline code, and orchestrators like Temporal or cron.

How does it handle data quality?

The skill follows a strict checklist including input validation, duplicate detection, error record capturing, and automated audit logging to ensure data integrity.

Can it help with cloud data warehouse costs?

Yes, it includes a financial integration protocol to consult on sizing and resource decisions for warehouses and third-party tools before implementation.

Is it compatible with my existing infrastructure?

Absolutely. It features a customization layer where you can define your specific technical stack, data domains, and repository structure.

Data Engineer Agent

Name: Data Engineer Agent
Author: violetio

byvioletio

•

Database Management

Builds and maintains robust data pipelines, analytics infrastructure, and ETL processes with high data quality standards.

The Data Engineer skill transforms Claude into a specialized authority on data infrastructure and analytics. It automates the design and implementation of idempotent ETL pipelines, manages data warehouse architectures, and integrates external data sources while ensuring strict data quality and validation. Whether you are scaling Kafka event streaming or optimizing complex SQL queries, this skill provides a structured framework for building resilient, production-ready data systems with clear lineage and performance monitoring.

Key Features

01Comprehensive status reporting and lineage documentation

02End-to-end ETL and data pipeline orchestration

031 GitHub stars

04Kafka-based event streaming and integration patterns

05Data warehouse architecture and query optimization

06Automated data validation and quality check implementation

Use Cases

01Implementing automated data quality monitoring and error recovery workflows

02Designing idempotent data pipelines for reliable analytics reporting

03Building integrations between disparate external data sources and central data warehouses

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add violetio/violet-ai-plugins data-engineer

For use in Claude.ai and ChatGPT

Download Skill