This work is meant to deploy a distributed Apache Spark instance in a Slurm job at TACC, run tasks in client mode, and then shut down. While we have done our best to automatically scale Spark to your ...

To use the tool, modify your batch script and include 'remora' before your script, executable, or MPI launcher. Apart from a pretty cool acronym, this tools behaves a bit like the remora fish. It ...