mpitune_fast tuning file

[Matthew_Grismer]

I've run mpitune_fast on our cluster for each of the available benchmarks, and an MPI tuning file was produced for each.  But, it seems like I need to combine them into one file in order to use them  with MPI.  The alternative appears to be to run mpitune_fast for all the benchmarks in one command, but when I tried this it was taking too long for the queues on the system.  Is there a way to combine the individual benchmark tuning files into on tuning file for all the benchmarks?

[Mahan]

Hi Matthew,

If you are using mpitune_fast, then it will able to create a merged file for all the mpi applications that you need. This can be done in the following manner, here I am doing it for four mpi functions

mpitune_fast -f ./hostfile -c allreduce,bcast,barrier,reduce

After the run finishes a folder named "tuning_results" will be created which will contain the merged .dat file

Please let me know does this answer your question.

[Matthew_Grismer]

Unfortunately I cannot run all the applications in one invocation of mpitune_fast (at the scale that I want) because it takes too long for the queues on the machine, i.e. it takes 2 days for the allreduce application alone to run.  So, I ran them all separately, but now have separate .dat files that I would like to merge into one.

[Mahan · Accepted solution]

Hi Matthew,

In that case you can us the following to merge many tuning files to create a master tuning .dat file

I_MPI_TUNING_BIN=tuned1.dat,tuned2.dat  \

I_MPI_TUNING_BIN_DUMP=./tuned_merged.dat mpirun -n 1 ./dummy_mpi_app

​Here, the dummy_mpi_app could be any dummy mpi executable

Please let me know if this is what you are looking for.