I'm trying to launch an application with Intel MPI and Mellanox FCA. But is doesn't seem to work. I try to do it the way it is suggested in the example script which comes with FCA. It says to add these parameters:
-genv DAT_OVERRIDE /etc/dat.conf
-genv I_MPI_DAT_LIBRARY /usr/lib/libdat2.so
-genv I_MPI_DAPL_COLLECTIVES all \\
-genv fca_mpi_debug_level 3
Unfortunately those options don't work for me. With the first two the app fails to start saying that "dapl fabric is not enabled". Without the first two parameters app works but I don't see any differences with regular results. The instruction says I need to specify the correct path ($DAPL_HOME) for dat.conf and libdat2.so. I only have one copy of each file so I used the pathes as specified above.
So my questions are:
1) What version of Intel MPI do I need? I use 4.0.3.008
2) What version of FCA do I need? I use the one which comes the latest MLNX OFED 1.5.3-3.1.0
3) What parameters should I use to enable FCA support?
