Does it include data validation checks?

Yes, it produces comprehensive data quality check functions to verify data types, value ranges, and unique identifiers after the cleaning process.

How does it handle statistical outliers?

The generated pipelines include implementations for both Interquartile Range (IQR) and Z-score methods to identify and filter statistical anomalies.

Does this skill support big data frameworks?

Yes, it generates optimized cleaning pipelines for PySpark and Polars in addition to standard Pandas workflows.

Can I customize the cleaning strategies?

Absolutely. The skill generates modular Python classes and functions that allow you to define custom imputation strategies, encoding methods, and validation ranges.

Data Cleaning Pipeline Generator

Name: Data Cleaning Pipeline Generator
Author: Dexploarer

byDexploarer

•

Data Science & ML

Automates the creation of robust data cleaning and preprocessing pipelines for Python-based data science workflows.

This skill streamlines the tedious process of data preparation by generating standardized cleaning pipelines for Pandas, Polars, and PySpark. It provides a modular, class-based framework to handle common data quality issues including missing value imputation, duplicate removal, statistical outlier detection, and text normalization. By providing best-practice implementations for both small-scale analysis and big data environments, it ensures that your datasets are validated and production-ready with minimal manual boilerplate.

Key Features

01Modular pipeline generation for Pandas, Polars, and PySpark

02Data type validation and automatic datetime conversion

03Automated missing value imputation and duplicate removal

04Comprehensive data quality reporting and logging

05Statistical outlier detection using IQR and Z-score methods

062 GitHub stars

Use Cases

01Migrating cleaning logic from Pandas to high-performance Spark jobs

02Standardizing data preprocessing for machine learning models

03Cleaning messy CSV or Parquet files for analytical reports

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add dexploarer/claudius-skills data-cleaning-pipeline

For use in Claude.ai and ChatGPT

Download Skill