topic Re: Pardiso with OpenMP problem in Intel® oneAPI Math Kernel Library

Pardiso with OpenMP problem

zidanea — Wed, 15 Jun 2022 01:24:09 GMT

Hello,

According to the manual of pardiso (link) setting iparm(2) = 3, the solver runs in parallel using the maximum number of threads.

In my case the pardiso solver crashes with the following message

Intel MKL INTERNAL ERROR: Condition -1 detected in function MKL_DCSRCOO.
"

The error code is: -2 which stands for "not enough memory", which is strange in this case since

if I just change the visual studio project properties from Generate Parallel Code (/Qopenmp) to Generate Sequential Code (/Qopenmp-stubs) in Language (process omp directives) then it works fine. But then it works sequential not parallel.

Any help how to use pardiso with openmp is appreciated.

Thanks

Re:Pardiso with OpenMP problem

VidyalathaB_Intel — Wed, 15 Jun 2022 10:57:07 GMT

Hi,

Thanks for reaching out to us.

Could you please let us know the MKL version being used in this case? Also please provide us with a sample reproducer (maybe you can attach your VS project file here) so that we can work on it from our end.

Regards,

Vidya.

Re: Re:Pardiso with OpenMP problem

zidanea — Wed, 15 Jun 2022 13:09:45 GMT

Hi,

I'm using the mkl from oneapi.

Please see attached the VS project.

If you make the process omp directives to Generate Parallel Code (/Qopenmp) it doesn't work, if you make it sequential it works.

Hope you can help with this!

Thanks

Re: Pardiso with OpenMP problem

VidyalathaB_Intel — Thu, 16 Jun 2022 12:53:20 GMT

Hi,

Thanks for sharing the details.

I could reproduce the issue from my end when enabling /Qopenmp in the language field of the settings page.

Since we already set the MKL to run in parallel mode (Under configuration properties > Fortran > Libraries > Use MKL > /Qmkl: parallel), I tried disabling the Generate Parallel Code (/Qopenmp) option because

the MKL manual says,

"In the parallel mode, Intel® oneAPI Math Kernel Library utilizes multiple processor cores available on your system (uses the number of OpenMP threads equal to the number of physical cores on the system), uses the OpenMP*or Intel TBB threading technology, and requires a proper threading runtime library (RTL) to be linked with your application and the threading RTLs are provided by your compiler."

After disabling the option, I could see that output as shown in the below screenshot with the total count of threads being used in the code which shows that it is working in parallel mode as well.

Please refer to the below link and do let me know if I miss anything.

https://www.intel.com/content/www/us/en/develop/documentation/onemkl-windows-developer-guide/top/linking-your-application-with-onemkl/linking-in-detail/linking-with-threading-libraries.html

Regards,

Vidya.

Re: Pardiso with OpenMP problem

zidanea — Thu, 16 Jun 2022 13:25:54 GMT

Thanks Vidya, I followed your instructions, and I used a loop of 1 M iterations of the two calls to the solver to see if what we're doing here is actually taking advantage of the parallel process.

So the result is that sequential is more efficient? Are we really doing things right here ?

Here's the results:

Process OpenMP directives: Disable
Threads>> 8
Simulation time(sec): 295.1770

Process OpenMP directives: Generate Sequential Code (/Qopenmp-stubs):
Threads>> 1
Simulation time(sec): 293.5310

Re:Pardiso with OpenMP problem

VidyalathaB_Intel — Thu, 16 Jun 2022 15:10:39 GMT

Hi,

Thanks for getting back to us.

Could you please let me know how did you measure/calculate the simulation time here (maybe you can give me the steps you are following)?

Regards,

Vidya.

Re: Re:Pardiso with OpenMP problem

zidanea — Thu, 16 Jun 2022 15:18:16 GMT

Hello,

I used the following:

CALL system_clock(count_rate=rate)
call SYSTEM_CLOCK(timein)

!
do i = 1,1000000
write(*,*)'Solve once!'
call LINEAR_SOLVER_PARDISO
write(*,*)'Solve twice!'
call LINEAR_SOLVER_PARDISO
enddo
call SYSTEM_CLOCK(timeout)

!
write(*,*)'Simulation time(sec):',real(timeout-timein)/real(rate)

Thanks

Re:Pardiso with OpenMP problem

VidyalathaB_Intel — Wed, 22 Jun 2022 06:35:42 GMT

Hi,

Thanks for sharing the details.

We are working on your issue. we will get back to you soon.

Regards,

Vidya.

Re: Re:Pardiso with OpenMP problem

zidanea — Wed, 22 Jun 2022 14:06:03 GMT

Thank you, I'll be waiting!

Re:Pardiso with OpenMP problem

Khang_N_Intel — Wed, 22 Jun 2022 17:44:36 GMT

Hi Ali,

I will do some investigation and will get back to you.

Best,

Khang

Re: Re:Pardiso with OpenMP problem

zidanea — Wed, 22 Jun 2022 17:46:42 GMT

Thanks Khang!

Re: Re:Pardiso with OpenMP problem

zidanea — Thu, 21 Jul 2022 12:45:23 GMT

Hi Khang,

Any updates so far ?

Thanks,