Skip to content

Workflow management

Related pages: Dependency management

Resources

Collections:

Workflow managers

Snakemake

Tutorials:

Nextflow

  • A DSL for parallel and scalable computational pipelines | Nextflow
  • Nextflow โ€” Nextflow documentation

    Nextflow is a workflow system for creating scalable, portable, and reproducible workflows. It uses a dataflow programming model that simplifies writing parallel and distributed pipelines by allowing you to focus on data flow and computation. Nextflow can deploy workflows on a variety of execution platforms, including your local machine, HPC schedulers, and cloud. Additionally, Nextflow supports a range of compute environments, software container runtimes, and package managers, allowing workflows to be executed in reproducible and isolated environments.

Airflow

Luigi

Prefect

Software build systems

Make

CMake

SCons

CI/CD

GitHub Actions