Intel® MPI Library
Get help with building, analyzing, optimizing, and scaling high-performance computing (HPC) applications.

MPI rank hangs on single node

Jamie9
Beginner
1,608 Views

Hello,

 

 I have noticed that every few runs my program hangs on the second MPI rank.

This Fortran program comes from Intel Community web site as an example of hybrid Open MP and MPI programming style.

 

Details:

env: Windows 10 Pro x64 21H1, Processor Intel(R) Core(TM) i7-8565U CPU @ 1.80GHz, 4 cores HT:ON,  ifort 2021.5.0, Intel MPI 2021.5

compilation command:  mpif90 -Qopenmp hybrid-hello.f90

run command: mpiexec -np 2 hybrid-hello.exe

 

Please share your thoughts how to get rid of these hangs.

Thank you in advance,

Jamie

 

 

Labels (3)
0 Kudos
5 Replies
HemanthCH_Intel
Moderator
1,581 Views

Hi,

 

Thank you for posting in Intel Communities.

 

We are able to reproduce your issue at our end by using the below command.

mpiexec -n 2 -genv OMP_NUM_THREADS=8 -genv I_MPI_PIN_DOMAIN=omp hybrid-hello.exe

We are working on your issue and will get back to you soon.

 

Thanks & Regards,

Hemanth.

 

0 Kudos
HemanthCH_Intel
Moderator
1,543 Views

Hi,

 

We are still investigating your issue and will get back to you soon.

 

Thanks & Regards,

Hemanth.

 

0 Kudos
HemanthCH_Intel
Moderator
1,455 Views

Hi,

 

We tried to check the correctness of your code using the below command:

 

 

 

mpif90 -check_mpi hybrid-hello.f90 -Qopenmp

mpiexec -n 2 -genv OMP_NUM_THREADS=8 hybrid-hello.exe --itc-args --check-tracing ON --itc-args-end

 

 

 

Using the above command, we encountered a deadlock as attached in the below log file(deadlock.txt).

Could you please try with the attached code(hybrid_hello_latest.f90) where we added: "!$OMP BARRIER" in line no:155 as shown in the screenshot?

HemanthCH_Intel_0-1647269287984.png

 

We have tried at our end and it works fine. We also checked the correctness of the program which gave the expected results(output.txt)

Please let us know if this resolves your issue. If not, please get back to us.

 

Thanks & Regards,

Hemanth.

 

 

0 Kudos
Jamie9
Beginner
1,424 Views

Hello,

 

 It works as expected after you added !$OMP BARRIER. Thank you very much.

Best Regards,

Jamie9

0 Kudos
HemanthCH_Intel
Moderator
1,371 Views

Hi,


Glad to know that your issue is resolved. If you need any additional information, please post a new question as this thread will no longer be monitored by Intel.


Thanks & Regards,

Hemanth.


0 Kudos
Reply