How does this skill handle long-running tests?

The skill enforces a strict 180-second timeout per test to prevent the suite from hanging and ensures efficient resource usage.

How are test failures categorized in the summary?

Failures are classified into specific types: FAIL (mismatches), ERROR (exceptions), TIMEOUT (hangs), CRASHED (interpreter failure), and LEAKED (resource leaks).

Does it support parallel execution?

Yes, it utilizes parallel execution via the -j0 flag in the underlying script to maximize hardware performance.

What happens if my CPython checkout is missing a branch?

You can re-run the skill with the FETCH_CPYTHON=1 environment variable to allow it to perform a network update.

CPython Regression Test Runner

Name: CPython Regression Test Runner
Author: ahupp

byahupp

0•

Security & Testing

Executes and analyzes the CPython regression test suite with parallel processing and automated failure summarization.

This skill provides a robust framework for running the extensive CPython regression test suite, specifically tailored for projects like diet-python. It automates the complex process of executing tests in parallel, enforcing per-test timeouts to prevent hangs, and capturing all output into a centralized log file. Its standout capability is the intelligent analysis of test logs, where it uses regex to identify, classify, and summarize various failure modes such as assertion mismatches, environment leaks, and interpreter crashes, providing developers with an actionable overview of test health.

Key Features

010 GitHub stars

02Standardized summarization of errors, crashes, and leaks

03Automated network fetching for outdated CPython checkouts

04Configurable 180-second per-test timeout enforcement

05Parallel test execution with optimized resource utilization

06Regex-based failure extraction and categorization

Use Cases

01Debugging specific regression failures by analyzing categorized log summaries

02Validating custom Python interpreter modifications against the official regression suite

03Automating core language testing within a continuous integration pipeline

What are Skills?·How to Install

Install with 🐟 Skill.Fish

npx skillfish add ahupp/diet-python run-cpython-tests

For use in Claude.ai and ChatGPT

Download Skill