Intel® MPI Library
Get help with building, analyzing, optimizing, and scaling high-performance computing (HPC) applications.
2218 Discussions

MPI_Init alllocates massive amounts of memory

JakobFilser
Beginner
1,516 Views

I am trying to run an MPI application compiled with mpiifort

 

ifort (IFORT) 2021.6.0 20220226

 

using mpiexec.hydra

 

Intel(R) MPI Library for Linux* OS, Version 2021.6 Build 20220227 (id: 28877f3f32)

 

on a machine with 36 cores

 

Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz

 

Here is a minimal example program:

program test
implicit none
integer :: mpi_err

include "mpif.h"

call MPI_INIT(mpi_err)
call MPI_FINALIZE()

end program


When calling MPI_INIT, massive amounts of memory (tens of GB) are allocated. The amount seems to increase with the number of cores. With more than 30 cores, MPI crashes because it runs out of memory.

0 Kudos
8 Replies
HemanthCH_Intel
Moderator
1,484 Views

Hi,


Thanks for posting in Intel Communities.


>>"When calling MPI_INIT, massive amounts of memory (tens of GB) are allocated. The amount seems to increase with the number of cores."

Could you please let us know how you are checking the memory consumption used by the MPI_INIT?


Thanks & Regards,

Hemanth



0 Kudos
JakobFilser
Beginner
1,480 Views

Hi,

 

thanks for your response. I get the load from the Xfce4 Systemload plugin https://docs.xfce.org/panel-plugins/xfce4-systemload-plugin/start

 

Best

Jakob

0 Kudos
HemanthCH_Intel
Moderator
1,438 Views

Hi,


We are investigating your issue at our end and will get back to you soon.


Thanks & Regards,

Hemanth


0 Kudos
HemanthCH_Intel
Moderator
1,420 Views

Hi,


Could you please provide the steps to install the Xfce plugin and also let us know if there are any dependencies?


Thanks & Regards,

Hemanth.


0 Kudos
JakobFilser
Beginner
1,416 Views

Hi,

 

unfortunately I do not know this either. I got the computer from my employer with the OS (and desktop environment, of which xfce is part) already installed. Sorry about this.

 

Thanks for your efforts and best

Jakob

0 Kudos
HemanthCH_Intel
Moderator
1,382 Views

Hi,

 

In the above post, we can see that you are using include "mpif.h". It is not recommended to use "mpif.h".By using APS we can see the memory consumed by the program attached is less than 300MB.

HemanthCH_Intel_0-1655460672820.png

By using the below commands, you can find the memory consumed by mpi application:

 

mpiifort hello_mpi.f90
export MPS_STAT_LEVEL=5
mpirun -n 2 aps -c mpi ./a.out
The above command will generate the aps_result_<date> file
aps --report /home/intel/hemanth/mpi_threads/fortran/latest/aps_result_20220617 
The above command will generate the time,memory consumed by the application. It also generates the HTML file.

 

 

For more information refer to the below link:

https://www.intel.com/content/www/us/en/develop/documentation/get-started-with-application-performance-snapshot/top.html

 

Thanks & Regards,

Hemanth

 

0 Kudos
HemanthCH_Intel
Moderator
1,360 Views

Hi,


We haven't heard back from you. Could you please provide an update on your issue?


Thanks & Regards,

Hemanth


0 Kudos
HemanthCH_Intel
Moderator
1,342 Views

Hi,


We assume that your issue is resolved. If you need any additional information, please post a new question as this thread will no longer be monitored by Intel.


Thanks & Regards,

Hemanth


0 Kudos
Reply