Generates standardized Python or shell wrapper scripts for individual Pegasus workflow pipeline steps.
This skill streamlines the creation of execution wrappers for the Pegasus Workflow Management System, providing automated templates for both CLI tools and API-based data fetching. It ensures consistency between workflow definitions and execution scripts by automatically aligning arguments, handling directory creation, managing output flattening for complex tools, and providing the necessary integration code for Transformation and Replica catalogs. It is particularly useful for scientists and developers in bioinformatics, Earth sciences, and data-intensive fields where complex pipeline steps require robust error handling and structured logging for high-throughput computing environments.
Key Features
01Argparse synchronization between wrappers and workflow generators
02Smart output flattening for tools with nested directory structures
03Automated Python and Shell template generation based on tool requirements
04Automatic generation of Transformation and Replica Catalog entries
050 GitHub stars
06Structured logging and exit code propagation for Pegasus observability
Use Cases
01Wrapping bioinformatics CLI tools like samtools or BWA for genomic pipelines
02Standardizing custom Python analysis scripts for distributed high-throughput computing
03Creating API-based data fetching scripts for Earth science workflows
