About
The data-quality skill provides a comprehensive framework for data engineers to implement automated quality gates within their pipelines. It offers tools to measure critical dimensions such as completeness, uniqueness, and freshness while providing advanced capabilities like statistical distribution drift detection using Scipy. By generating detailed scorecards and HTML reports, it enables teams to maintain high data standards, ensure reliability in production environments, and proactively identify data staleness or logical inconsistencies before they impact downstream analytics.
