Can I use this for real-time feature engineering?

Yes, the skill includes patterns for both batch training pipelines and real-time feature processing combined with stream processing.

How does this skill handle data versioning?

It implements best practices for data lineage and versioning using tools like DVC to ensure reproducibility across the entire pipeline.

What tools does this MLOps skill support?

It provides guidance for major orchestration tools like Apache Airflow, Dagster, and Kubeflow, as well as tracking tools like MLflow and Weights & Biases.

Does it help with model monitoring?

Absolutely. It includes strategies for monitoring production traffic, detecting model drift, and setting up automated rollback triggers.

ML Pipeline & MLOps Workflow

Name: ML Pipeline & MLOps Workflow
Author: drgaciw

bydrgaciw

0•

Data Science & ML

Orchestrates end-to-end MLOps pipelines from data ingestion and preparation to model training, validation, and production deployment.

This skill provides a comprehensive framework for building and automating production-grade machine learning pipelines. It guides users through the entire ML lifecycle, including designing Directed Acyclic Graphs (DAGs), implementing data validation with tools like Great Expectations, managing experiment tracking via MLflow, and executing advanced deployment strategies like canary or blue-green releases. It is an essential resource for data scientists and ML engineers looking to move from experimental notebooks to reproducible, scalable, and monitored production systems.

Key Features

010 GitHub stars

02Advanced deployment strategies including canary and blue-green rollouts

03End-to-end DAG orchestration for tools like Airflow, Dagster, and Kubeflow

04Automated data validation and feature engineering pipeline patterns

05Comprehensive model monitoring and performance regression detection

06Integrated experiment tracking and model registry management

Use Cases

01Setting up continuous training systems triggered by data or model drift

02Implementing reproducible training workflows with integrated data versioning

03Automating the transition from data exploration to production-ready ML pipelines

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add drgaciw/academic-compliance-hub-glm ml-pipeline-workflow

For use in Claude.ai and ChatGPT

Download Skill