Executors
In Nextflow, the executor is the component that runs the tasks submitted by a pipeline.
The executor provides an abstraction between the pipeline definition (what it computes) and the underlying execution system (how it runs). You can write a pipeline once and run it on your local machine, a high-performance computing (HPC) cluster, or in the cloud by changing the executor in the Nextflow configuration.
Use process.executor to set the executor, e.g. process.executor = 'slurm'. Nextflow uses the local executor by default.
Local
| Page | Name | Description |
|---|---|---|
| Local | local | Runs tasks as operating system processes on the local machine. |
Cloud
| Page | Name | Description |
|---|---|---|
| AWS Batch | awsbatch | Submits tasks to AWS Batch. |
| Azure Batch | azurebatch | Submits tasks to Azure Batch. |
| Google Cloud Batch | google-batch | Submits tasks to Google Cloud Batch. |
| Kubernetes | k8s | Submits tasks to a Kubernetes cluster. |
| Seqera | seqera | Submits tasks to Seqera Intelligent Compute. |
HPC schedulers
| Page | Name | Description |
|---|---|---|
| Bridge | bridge | Submits tasks through the Bridge abstraction layer. |
| Flux | flux | Submits tasks to the Flux Framework. |
| HTCondor | condor | Submits tasks to the HTCondor resource manager. |
| HyperQueue | hq | Submits tasks to the HyperQueue job scheduler. |
| LSF | lsf | Submits tasks to a Platform LSF cluster. |
| Moab | moab | Submits tasks to the Moab resource manager. |
| NQSII | nqsii | Submits tasks to the NQSII resource manager. |
| OAR | oar | Submits tasks to the OAR resource manager. |
| PBS/Torque | pbs | Submits tasks to a PBS/Torque scheduler. |
| PBS Pro | pbspro | Submits tasks to the PBS Pro resource manager. |
| SGE | sge | Submits tasks to an SGE cluster or compatible platform. |
| SLURM | slurm | Submits tasks to the SLURM resource manager. |
| TCS | tcs | Submits tasks to a Fujitsu TCS cluster. |