How to increase performance of MPI one-sided performance with Intel MPI?

Intel® MPI Library

Get help with building, analyzing, optimizing, and scaling high-performance computing (HPC) applications.

How to increase performance of MPI one-sided performance with Intel MPI?

537 Views

Hello,

we have an application with basically two (last) sequence of actions in the domain decomposition:

one set of tasks (subset a) calls

call mpi_win_lock(some_rank_from_subset_b)
call mpi_win_get(some_rank_from_subset_b)
call mpi_win_unlock(some_rank_from_subset_b)

the others (subset b) are stuck in the MPI_Barrier at the end of the domain decomposition. This performs nicely (passes domain decomposition within seconds) with MVAPICH on our new Intel Xeon machine and on another machine with IBM BlueGene/Q hardware.

Unfortunately with Intel MPI on the same machine that breeezes through with MVAPICH, we get significantly less performance out of the same code: it hangs at this stage of domain decomposition for approximately 10 minutes. The hardware in question is equipped with Mellanox ConnectX-3 IB HCAs. We run RHEL6.

How can I improve passive target performance?

Regards, Thomas

Link Copied

0 Replies

Community support is provided Monday to Friday. Other contact methods are available here.

Intel does not verify all solutions, including but not limited to any file transfers that may appear in this community. Accordingly, Intel disclaims all express and implied warranties, including without limitation, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement, as well as any warranty arising from course of performance, course of dealing, or usage in trade.

For more complete information about compiler optimizations, see our Optimization Notice.