topic Hi Nils, in Intel® oneAPI Math Kernel Library

MKL, PARDISO, scaling: Quad-Core vs. Dual-Core

Perpf2000 — Tue, 01 Sep 2009 13:34:41 GMT

...and one more question:
To verify the performance improvements with PARDISO, i used a certain benchmark-problem with my App. I was really happy to see, that it would be roughly two times faster than my old solver, because the old one does not make use of multicores. With this result on a Dual-Core, I expected to see some threefold increase on my Quad-Core. But amazingly the speed increase was again just a factor of two.
Dual-Core: Old Solver:72sec, PARDISO: 35sec
Quad-Core: Old Solver: 66sec, PARDISO: 32sec
(the quad-core has slightly faster clock & memory)
Does it really scale that poorly with more cores? Or am I doing something wrong?

thanks,

Re: MKL, PARDISO, scaling: Quad-Core vs. Dual-Core

TimP — Tue, 01 Sep 2009 15:46:38 GMT

So little information. Did you try setting KMP_AFFINITY=compact, or some such, which is likely to be needed if you have a Core 2 QuAD running 4 threads? Are you depending on automatic selection of number of threads, and how many did it choose? If it chose 2 threads, possibly that corresponds with your problem size.

Re: MKL, PARDISO, scaling: Quad-Core vs. Dual-Core

Perpf2000 — Wed, 02 Sep 2009 07:44:28 GMT

Quoting - tim18

here comes more:

No, I didn't use KMP_AFFINITY yet. Yes I'm using Core2-Type Processors (one System has a Duo, the other one a Quad). Using the Task-Manager System-Perormance graph, CPU load always went to (or close to) 100% with roughly equal loading on the different cores.

One more interesting thing:
I meanwhile checked with a single-core-machine as well. It looks like the improvement over my old solver (UMFPACK) is largest on the single-core, something like a factor of almost three. The difference between the old (single thread-)solver and MKL-PARDISO is only on the scale of two on the multi-core-machines ?.?...
Please don't invest any time into answering this last question, as I don't NEED to know why this is- I'm just happy it is!

But for the multi-core-issue I'd really appreciate your assistance, as it would obviously be nice being able to exploit the potential performance-benfits of multicores (especially for the future!)...

please let me know, if you need any more info!

thanks,

Re: MKL, PARDISO, scaling: Quad-Core vs. Dual-Core

Perpf2000 — Wed, 02 Sep 2009 21:31:44 GMT

... I tried KMP_AFFINITY=granularity=fine,compact,1,0. No improvement!
I have read a lot about MKL scaling very well- what am I doing wrong?

The improvement from 1 core to 4 cores is like a 20% drop in calculation time...

???

Re: MKL, PARDISO, scaling: Quad-Core vs. Dual-Core

Konstantin_A_Intel — Thu, 03 Sep 2009 03:03:46 GMT

Hello, could you please provide us with more details about your run?
What is the size of your matrix? Did you set the number of threads via OMP_NUM_THREADS variable or just kept it to be chosen automatically?

It would be great if you provide us with the matrix or withthe code example as well.

Konstantin

Re: MKL, PARDISO, scaling: Quad-Core vs. Dual-Core

Perpf2000 — Thu, 03 Sep 2009 09:09:08 GMT

Quoting - Konstantin Arturov (Intel)

Hello!
It'a a 3500x3500 complex, symmetric, extremely sparse matrix. Using mtype=6
I tried the use of KMP_AFFINITY (see above), no notable change.
I used MKL_NUM_THREADS (or OMP_NUM_THREADS, I don't recall- does it make a difference?) to limit the number of threads to ONE in order to compare with the performance of all (two or four threads/cores depending on machine) threads. For the "all-case" I did not set MKL_NUM_THREADS (or OMP_NUM_THREADS).
My steps are:

Phase 11: symbolic factorization (done only once)
loop: (few hundred times)
{
Phase 22
Phase 33
}
cleanup

Do you need the matrix itself?

thanks,

Re: MKL, PARDISO, scaling: Quad-Core vs. Dual-Core

Perpf2000 — Thu, 03 Sep 2009 09:10:53 GMT

- reply showed up twice -

Re: MKL, PARDISO, scaling: Quad-Core vs. Dual-Core

TimP — Thu, 03 Sep 2009 13:08:53 GMT

Quoting - Perpf2000

It'a a 3500x3500 complex, symmetric, extremely sparse matrix. Using mtype=6

Can we assume then that it has a high cache miss rate? That would match the symptom that performance depends more on memory speed than on number of cores.

Re: MKL, PARDISO, scaling: Quad-Core vs. Dual-Core

Perpf2000 — Thu, 03 Sep 2009 17:30:21 GMT

Quoting - tim18

Can we assume then that it has a high cache miss rate? That would match the symptom that performance depends more on memory speed than on number of cores.

...and for dummies that would mean?
and what could I do about it?

tnx

Re: MKL, PARDISO, scaling: Quad-Core vs. Dual-Core

Konstantin_A_Intel — Fri, 04 Sep 2009 07:11:13 GMT

Quoting - Perpf2000

In fact, the matrix isvery small. I mean that thereare few computations to supply all threads with enough amount of work. Anyway, wewill appreciate if you send your testcase (matrix) to us. We would add it to the testbase of user testcases and could track it in future releases.

Thanks,
Konstantin

Re: MKL, PARDISO, scaling: Quad-Core vs. Dual-Core

Perpf2000 — Fri, 04 Sep 2009 08:12:30 GMT

Quoting - Konstantin Arturov (Intel)

Konstantin,

if there was'n enough work for every thread, why are (on the Quad-Core) all four threads 100%-busy for many seconds at each step of the loop?
please clarify! thank you!

Re: MKL, PARDISO, scaling: Quad-Core vs. Dual-Core

Konstantin_A_Intel — Mon, 07 Sep 2009 10:26:51 GMT

Quoting - Perpf2000

Konstantin,

if there was'n enough work for every thread, why are (on the Quad-Core) all four threads 100%-busy for many seconds at each step of the loop?
please clarify! thank you!

I don't know the exact answer and can only guess. It will be easier for me to take a look at the test. Please, send your matrixin order I can make some runs.

Re: MKL, PARDISO, scaling: Quad-Core vs. Dual-Core

Perpf2000 — Mon, 07 Sep 2009 13:44:04 GMT

Quoting - Konstantin Arturov (Intel)

I don't know the exact answer and can only guess. It will be easier for me to take a look at the test. Please, send your matrixin order I can make some runs.

OK! Understand that!
What format should the matrix be? I could probably generate a text file with the Complex entries as CSV or samoething like that. What exactly would you need?

tnx

Re: MKL, PARDISO, scaling: Quad-Core vs. Dual-Core

Konstantin_A_Intel — Tue, 08 Sep 2009 11:23:29 GMT

Quoting - Perpf2000

OK! Understand that!
What format should the matrix be? I could probably generate a text file with the Complex entries as CSV or samoething like that. What exactly would you need?

tnx

If you don't have the matrix in HB format or smth like this, you could just senda text file, coordinate format would be Ok: a sequence of strings "i j value".

Thanks,
Konstantin

Re: MKL, PARDISO, scaling: Quad-Core vs. Dual-Core

Perpf2000 — Tue, 08 Sep 2009 18:31:40 GMT

Quoting - Konstantin Arturov (Intel)

If you don't have the matrix in HB format or smth like this, you could just senda text file, coordinate format would be Ok: a sequence of strings "i j value".

Thanks,
Konstantin

OK!

I will be out of town for a while; so it will take a little time until I can send the data. But I#ll get back to this!

Thanks so far!

Re: MKL, PARDISO, scaling: Quad-Core vs. Dual-Core

h88433 — Thu, 01 Apr 2010 17:48:48 GMT

Hello, I know this thread is old, but I am having the same difficulties. See Pardiso Crash, user=h88433.

Was this issue ever cleared up ?

Hi!

Nils_Dirks — Mon, 19 Nov 2012 08:29:14 GMT

Hi! Well, it's been a while. I had to abandon this issue for a while as I was busy with other stuff. No, the issue wasn't yet cleared up. Im just now getting back to this problem and the poor scaling still troubles me. regards

Hi Nils,

Ying_H_Intel — Tue, 20 Nov 2012 06:47:00 GMT

Hi Nils, Are you trying the latest MKL version ( MKL 11.0 update 1) with the matrix? You may sumbit a issue to <> if any problem with uploading your matrix here. Best Regards, Ying