Can I use it for incremental loading strategies?

Absolutely. It includes best practices for dbt incremental models, Airflow TaskFlow partitioning, and S3-based data lake organization.

Is it compatible with modern Airflow patterns?

Yes, the skill focuses on modern Pythonic patterns like the TaskFlow API, dynamic task mapping, and the Cosmos integration for dbt.

Does it include data quality validation patterns?

Yes, it provides implementation patterns for data validation using Great Expectations, Airflow sensors, and SQL-based quality checks.

What orchestration tools are supported by this skill?

The skill supports major modern orchestrators including Apache Airflow (2.8+), Prefect, Dagster, and dbt Core.

Data Engineering & ETL Tools

Name: Data Engineering & ETL Tools
Author: pluginagentmarketplace

bypluginagentmarketplace

•

Data Science & ML

Automates production-grade ETL pipelines and data orchestration using industry-standard tools like Airflow, dbt, and Prefect.

This skill empowers Claude to design, implement, and maintain robust data infrastructure and ETL (Extract, Transform, Load) pipelines. It provides specialized knowledge for building scalable workflows with Apache Airflow's TaskFlow API, managing complex SQL transformations via dbt, and ensuring data integrity through quality frameworks like Great Expectations. Whether you are migrating legacy pipelines to modern orchestrators like Dagster or implementing incremental loading patterns for high-volume data, this skill ensures best practices for data engineering, error handling, and cloud-native integration.

Key Features

01Incremental SQL transformation modeling and dbt project management

02Workflow orchestration with Apache Airflow, Prefect, and Dagster

032 GitHub stars

04Automated data quality validation using Great Expectations

05Cloud-native data lake integration for AWS S3 and Postgres

06Dynamic task generation and sensor-driven pipeline triggers

Use Cases

01Implementing incremental data modeling and automated testing for analytics engineering

02Building daily batch ETL pipelines from transactional databases to data warehouses

03Creating self-healing data workflows with advanced retry and alert configurations

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add pluginagentmarketplace/custom-plugin-data-engineer etl-tools

For use in Claude.ai and ChatGPT

Download Skill