We have a little cluster: - master - 8 nodes with 12 cores pro nodes - Infiniband connectx DDR 2X - linux CentOS 5.5 - Infiniband stack from OFED - Intel MPI
At the moment we have a normal basic install of the infiniband packages. So we are in connected mode with a MTU of ~65k. Has anybody info, documentation, links on the optimization of the MTU ? We are using it for Computational Fluid Dynamics computations.
You can use any. OFA fabric gives you ability to use multi-rail feature (if you have 2 IB cards on a node or cards with 2 ports). Just compare performance of dapl and ofa with your application and use the fastest.