How does it handle complex dependencies?

The skill provides templates for linear, fan-out, fan-in, and conditional branching dependencies, including the use of Trigger Rules for advanced flow control.

Does it include patterns for testing DAGs?

Absolutely. It provides standardized approaches for unit testing DAGs using pytest and the Airflow DagBag to catch import errors and logic flaws before deployment.

Can it help with dynamic DAG generation?

Yes, it includes specialized patterns for creating DAG factories that generate multiple pipelines dynamically from JSON or YAML configuration files.

Does this skill support Airflow 1.x?

While the skill covers fundamental orchestration concepts, it specifically prioritizes Airflow 2.0+ best practices such as the TaskFlow API, decorators, and modern provider packages.

Apache Airflow DAG Patterns

Name: Apache Airflow DAG Patterns
Author: drgaciw

bydrgaciw

0•

Analytics & Monitoring

Builds production-grade Apache Airflow DAGs using industry best practices for orchestration, testing, and deployment.

This skill empowers Claude with specialized knowledge for architecting robust data pipelines using Apache Airflow. It enables the creation of idempotent, atomic, and observable workflows while implementing advanced patterns like the TaskFlow API, dynamic DAG generation, and complex branching logic. Whether you are debugging failed runs, setting up custom sensors, or implementing error-handling callbacks, this skill ensures your orchestration logic follows production-ready standards for reliability and maintainability in complex data environments.

Key Features

01Dynamic DAG generation for scalable pipeline factories

02Standardized testing patterns for DAG validation using pytest

03Production error handling and failure callback strategies

04Advanced sensor configurations and external task dependencies

05Implementation of Airflow 2.0+ TaskFlow API patterns

060 GitHub stars

Use Cases

01Implementing robust error handling and alerting for mission-critical data jobs

02Designing complex ETL/ELT data orchestration workflows with multi-task dependencies

03Automating the creation of multiple similar pipelines through dynamic factory patterns

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add drgaciw/academic-compliance-hub-glm airflow-dag-patterns

For use in Claude.ai and ChatGPT

Key Features

01Dynamic DAG generation for scalable pipeline factories

02Standardized testing patterns for DAG validation using pytest

03Production error handling and failure callback strategies

04Advanced sensor configurations and external task dependencies

05Implementation of Airflow 2.0+ TaskFlow API patterns

060 GitHub stars

Use Cases

01Implementing robust error handling and alerting for mission-critical data jobs

02Designing complex ETL/ELT data orchestration workflows with multi-task dependencies

03Automating the creation of multiple similar pipelines through dynamic factory patterns

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add drgaciw/academic-compliance-hub-glm airflow-dag-patterns

For use in Claude.ai and ChatGPT