MPI-IO on Devcloud

[Matthew_Grismer]

I am having issues running an MPI/OpenMP hybrid code that uses MPI-IO on Devcloud.  Several months back I ran the same code on Devcloud without issue.  The code now fails on a MPI_FILE_READ_ALL command (this is one one node with two MPI processes, 2 OpenMP threads, though changing the MPI processes or threads does not make a difference):

forrtl: severe (174): SIGSEGV, segmentation fault occurred

Image              PC                Routine            Line        Source             

fdl3di.exe         0000000000B0D96A  Unknown               Unknown  Unknown

libpthread-2.31.s  00007FEA38DE43C0  Unknown               Unknown  Unknown

libmpi.so.12.0.0   00007FEA394F5850  Unknown               Unknown  Unknown

libmpi.so.12.0.0   00007FEA393316B9  Unknown               Unknown  Unknown

libmpi.so.12.0.0   00007FEA3959FBEF  Unknown               Unknown  Unknown

libmpi.so.12.0.0   00007FEA396907C9  Unknown               Unknown  Unknown

libmpi.so.12.0.0   00007FEA3968913D  Unknown               Unknown  Unknown

libmpi.so.12.0.0   00007FEA38FEE023  Unknown               Unknown  Unknown

libmpi.so.12.0.0   00007FEA395AC74A  PMPI_Waitall          Unknown  Unknown

libmpi.so.12.0.0   00007FEA38E98803  Unknown               Unknown  Unknown

libmpi.so.12.0.0   00007FEA38E9743D  Unknown               Unknown  Unknown

libmpi.so.12.0.0   00007FEA398EC324  PMPI_File_read_al     Unknown  Unknown

libmpifort.so.12.  00007FEA3A5C5458  pmpi_file_read_al     Unknown  Unknown

fdl3di.exe         0000000000943470  mod_file_io_mp_re         188  mod_file_io.f90

fdl3di.exe         0000000000B0515C  MAIN__                     32  fdl3di.parallel.f90

fdl3di.exe         0000000000404C22  Unknown               Unknown  Unknown

libc-2.31.so       00007FEA386930B3  __libc_start_main     Unknown  Unknown

fdl3di.exe         0000000000404B2E  Unknown               Unknown  Unknown

I think one difference is the oneAPI tools have been updated since the last time I was on Devcloud, going from 2021.3.0 to 2021.4.0 I believe.  Any ideas?  Are there particular filesystems that I should be using with MPI-IO?  Thanks.

[JaideepK_Intel]

Hi,

Thank you for posting in Intel forums.

Can you please provide the sample reproducer (If you are using any oneAPI code sample please share the sample name) and steps to reproduce the issue?

Devcloud will be updated with latest oneAPI toolkits(current verion-2021.4.0). You can refer below link for more information:

https://www.intel.com/content/www/us/en/developer/tools/oneapi/overview.html#gs.e3ba1k

Here we have all the filesystems Intel MPI Support:

https://www.intel.com/content/www/us/en/developer/articles/release-notes/mpi-library-release-notes-linux.html#inpage-nav-6-1

Thanks,

Jaideep

[JaideepK_Intel]

Hi,

Can you please share the information provided above.

Thank you,

Jaideep

[JaideepK_Intel]

Hi,

I have not heard back from you. This thread will no longer be monitored by Intel. If you need further assistance, please post a new question.

Thanks,

Jaideep