it is not using two IB’s and the stats.ipm file is empty

[soni__deepak]

Hi,

i tried this one CFX job but it is not using two IB’s , i used following setting, 

export I_MPI_TMPDIR=/scratch/pwc/asd0392/tmp

export I_MPI_DEBUG=5

export I_MPI_FABRICS=shm:ofa

export I_MPI_FALLBACK=0

export I_MPI_OFA_NUM_ADAPTERS=2

export I_MPI_OFA_NUM_PORTS=1

export I_MPI_STATS=ipm

export I_MPI_STATS_FILE=stats.ipm

export I_MPI_HYDRA_BOOTSTRAP=lsf

export I_MPI_HYDRA_BRANCH_COUNT=${numhost}

export I_MPI_LSF_USE_COLLECTIVE_LAUNCH=1

export I_MPI_MPIRUN_CLEANUP=yes

export I_MPI_HYDRA_CLEANUP=yes

how to use infiniband dual-rail ?

regards

deepak

[PrasanthD_intel]

Hi,

Thanks for reaching out to us.

 Could you please provide which version of IMPI you are using.

Prasanth

[soni__deepak]

Thanks Prasanth for reply.

please find the version information

Intel(R) MPI Library for Linux* OS, Version 4.1 Update 3 Build 20140226

i have attached a log for it . may be get some more details 

how to use infiniband dual-rail ?

just adding one more query related to this issue 

any specific framework for osu-benchmark in intel cluster checker ?

regards

deepak 

[Michael_Intel]

Hi Deepak,

The Intel MPI 4.1 Version is quite outdated and not supported anymore.

In the latest Intel MPI 2019 update 6 library, we have a new OFI provider for InfiniBand called MLX, that will also be selected out of box. This provider will also run on multi-rail installations with the default configuration.

Best regards,

Michael