Intel® oneAPI Math Kernel Library
Ask questions and share information with other developers who use Intel® Math Kernel Library.

pardiso factorization speed

may_ka
Beginner
2,789 Views

Hi,

 

when using pardiso on an upper triangular symmetric matrix of dimension 130,00 x 130,000 with 1,000,000 non-zeros it needs about 15 sec for a factorization, which is very slow compared to cholmod(suitesparse) 0.3 sec.

 

Further on large matrices, say >1,000,000 x >1,000,000 pardiso is so unbearable slow that it becomes unusable, whereas cholmod(suitesparse) can easily cope with the problem.

 

Is there any way to speed up pardiso? I figured that it gets stuck at the analysis stage.

 

I am using oneapi version 2021.2.0 on linux, kernel version 5.16.

 

Thanks

0 Kudos
13 Replies
Gennady_F_Intel
Moderator
2,761 Views

The only way to speed up the reordering stage is by trying the OpenMP version of Metis (iparm[1]=3).

wrt to factorization performance against cholmod -- here make sense to share the case to check the behavior on our end.



0 Kudos
may_ka
Beginner
2,751 Views

Hi,

I'll make an example.

 

Question is how I can get he matrix to Intel? My current best example matrix with 12M rows/columns and 500M elements needs 11GB on disk!

0 Kudos
Gennady_F_Intel
Moderator
2,745 Views

You could upload the case anywhere ( google drive as an example) and give us the link by the private channel into this forum or directly via email ( Gennady.Fedorov@intel.com). And please add the driver which will write this matrix and run the solver with your parameters. It will essentially save the reproducing time.

-Gennady


0 Kudos
may_ka
Beginner
2,732 Views

Hi,

 

I have emailed you a link for downloading an archive with matrix and driver.

 

The example also reproduces the observation from this thread https://community.intel.com/t5/Intel-oneAPI-Math-Kernel-Library/omp-warning-when-using-pardiso-and-metis-threaded-version/td-p/1363562 

 

Thanks for looking into this.

0 Kudos
may_ka
Beginner
2,665 Views

Hi,

 

@Gennady_F_Intel wondering whether you had the time yet to look into the example provided?

 

I just installed oneapi 2022.0.2, and all the described problems remain, even the omp_nested warning from this thread 

0 Kudos
Gennady_F_Intel
Moderator
2,622 Views

I am very sorry, Karl. I missed this thread and will do it asap.


0 Kudos
may_ka
Beginner
2,540 Views

Hi Gennady,

 

I responded to your email some time ago pointing out that there must be an issue at your side reading the sparse array in binary.

 

Is there any update on this?

 

Best

0 Kudos
Gennady_F_Intel
Moderator
2,528 Views

Hi Karl,

I responded by email to you on this matter.

The reordering performance problem has been reproduced on our end and escalated against the Sparse Solver Team.

We will keep this thread updated in case of any updates.

thanks,

Gennady


0 Kudos
may_ka
Beginner
2,468 Views

Hi,

 

I had contacted the pardiso team about this problem as well, and according to their test and a test library they provided to me the problem does not affect the most recent pardiso version.

 

Does Intel have any plans for updating pardiso?

 

Thanks.

0 Kudos
Khang_N_Intel
Employee
2,366 Views

Hi Karl,


I just want to let you know that the team is still investigating this issue.

We will let you know once we find out the issue.


Best regards,

Khang


0 Kudos
Khang_N_Intel
Employee
2,248 Views

Hi Karl,


The issue has already been escalated to the mkl team.

Due to many changes, we might not have a solution at this time.

I will consult with the mkl team and will get back to with an estimated timelione.


Best regards,

Khang


0 Kudos
Khang_N_Intel
Employee
2,206 Views

Hi Karl,


The latest I received from the mkl team is that the solution might not be available until, to the earliest, the second half of next year.


Best regards,

Khang


0 Kudos
Mahan
Moderator
401 Views

Hi Karl.


This issue will be fixed in the upcoming oneAPI 2025.0 release.


0 Kudos
Reply