MPI on multiple machines

[yusufmansour]

We talked in class about how we've been running MPI on a "single machine" for demonstration purposes. If we were to run an MPI program and wanted to take advantage of multiple machines on a network, for example, how do we indicate how many and which machines should be utilized and how many processes they should each spawn?

[cswiercz]

How to run on multiple machines is something that I wanted to touch on in the next lecture.

In short, it requires writing a sort of configuration files with the desired IP addresses of each process. You need to share your ssh key with each of these servers in order for the program to be "farmed out" by MPI.