How does it manage model deployment?

The skill supports various serving patterns including shadow deployments, canary releases, and blue-green strategies to ensure safe production rollouts.

What orchestration tools does this skill support?

The skill provides patterns and templates for popular tools including Apache Airflow, Dagster, Kubeflow Pipelines, and Prefect.

Can I use this for experiment tracking?

Yes, it includes specific integration points for industry-standard tools like MLflow, Weights & Biases, and TensorBoard.

Is this skill suitable for both simple and complex projects?

Yes, it uses a progressive disclosure approach, starting with simple linear pipelines and scaling up to complex multi-model ensemble strategies.

Does it handle data versioning and lineage?

It offers comprehensive guidance on implementing data versioning and lineage tracking using tools like DVC to ensure pipeline reproducibility.

ML Pipeline Workflow

Name: ML Pipeline Workflow
Author: HermeticOrmus

byHermeticOrmus

0•

Data Science & ML

Orchestrates end-to-end MLOps pipelines from data preparation through model training, validation, and production deployment.

This skill provides comprehensive guidance for building production-grade ML pipelines using industry-standard orchestration patterns like Airflow, Dagster, and Kubeflow. It helps developers and data scientists automate the complete machine learning lifecycle, ensuring reproducible workflows, robust data validation, experiment tracking, and seamless deployment strategies such as canary or blue-green releases.

Key Features

010 GitHub stars

02Advanced deployment patterns including canary and A/B testing

03Experiment tracking and model registry integration

04Comprehensive model validation and regression detection

05End-to-end DAG orchestration and workflow design

06Automated data validation and feature engineering pipelines

Use Cases

01Building reproducible training workflows from scratch

02Automating data drift detection and model retraining triggers

03Implementing CI/CD for machine learning models (MLOps)

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add hermeticormus/after-the-third-cup ml-pipeline-workflow

For use in Claude.ai and ChatGPT

Download Skill