Intra- and Inter-node Parallel Computing on CADES with GNU-Parallel and Swift

CADES will host a training for Swift/T and GNU-parallel on September 2nd, 2021 from 1:00-2:00 pm.

GNU-Parallel is a shell tool for executing jobs in parallel using one or more computers. A job can be a single command or a small script that has to be run for each of the lines in the input. The typical input is a list of files, a list of hosts, a list of users, a list of URLs, or a list of tables. A job can also be a command that reads from a pipe. GNU parallel can then split the input and pipe it into commands in parallel.

Swift uses a C-like syntax to define workflows. Swift is capable of stitching computational steps defined in the workflow as a true HPC workflow that uses the Message Passing Paradigm of parallel computation using the MPI libraries and its own load balancer.

Tutorial Contents:

  • Syntax and Semantics
  • Examples
  • Demonstration on CADES
  • Potential Use-cases
  • Potential PitfallsTraining- Agent


Ketan Maheshwari
Linux Systems Engineer

Microsoft Teams meeting link

Join on your computer or mobile app

Click here to join the meeting