mpicleanup in MPI 4.0.3

[mateoguzman]

Hi,

I am trying MPI 4.0.3 and would like to know which is the best way to cleanup the environment after an mpirun execution using Hydra finishes incorreclty.

In previous versions (with MPDs) I was doing mpdallexit to ensure all daemons where down.

I tried usingI_MPI_HYDRA_CLEANUP environment variable to generate the input file for the mpicleanup tool, but it seems this file is never created.

This is how I am running mpi:

mpirun -r ssh -f /home/mguzman/wdir/mpd.host -genv I_MPI_FABRICS shm:dapl -env I_MPI_HYDRA_CLEANUP=1 -machinefile /home/mguzman/wdir/machinefile -n 16 /home/mguzman/wdir/test.impi

I have read that this file is erased when the job ends, so I tryed to look for that file while the command is being executed, but culdn't find it.

Am I doing something wrong? How can I force mpi to fail in order to try mpicleanup tool?

Thanks in advance

Mateo Guzman

[James_T_Intel]

Hi Mateo,

It generally takes a pretty bad failure for cleanup to not automatically occur. If you want to see the file, I would recommend starting a job that is either long enough or needs user input. While the job is waiting, you can look at the file and try mpicleanup. By default, the file should be in /tmp, in the form mpiexec_${username}_$PPID.log and will contain the PIDs of each process grouped by host.

Sincerely,
James Tullos
Technical Consulting Engineer
Intel Cluster Tools