topic ok, then please take a look in Intel® oneAPI Math Kernel Library

Different computation results on different processors using mkl_cbwr_set(int)

seredzhinov__renat — Mon, 10 Dec 2018 14:39:07 GMT

There are two desktop PC with the following processors: Intel Core i5 4570 (Haswell) and Intel Core i5 3330 (Ivy Bridge).
Use MKL 2019.0.1, build 20180928.
The app use PARDISO with the following settings: MKL_INT _mtype = 11; MKL_INT _nrhs = 1; MKL_INT _iparm1 = 2; MKL_INT _iparm3 = 0; MKL_INT _iparm4 = 2; MKL_INT _iparm7 = -1; MKL_INT _iparm9 = 13; MKL_INT _iparm10 = 1; MKL_INT _iparm12 = 1; MKL_INT _iparm20 = 2; MKL_INT _iparm23 = 0; MKL_INT _iparm33 = 1; MKL_INT _iparm34 = 1; mkl_domain_set_num_threads(1, MKL_DOMAIN_PARDISO);
Call the mkl_cbwr_set(MKL_CBWR_SSE2) and next PARDISO.
The native library was build using Microsoft Visual Studio 2017 (v141)
The mkl_intel_lp64.lib, mkl_intel_thread.lib, mkl_core.lib used as additional dependencies.
The app runs on both PC.
The calculation result is different. See attached files.

Please suggest a solution to my problem.

is that in-core mode?

Gennady_F_Intel — Tue, 11 Dec 2018 04:52:14 GMT

is that in-core mode?

yes, in-core mode. _iparm[59]

seredzhinov__renat — Tue, 11 Dec 2018 05:18:28 GMT

yes, in-core mode. _iparm[59] = 0.

ok, then please take a look

Gennady_F_Intel — Tue, 11 Dec 2018 10:49:52 GMT

ok, then please take a look at the iparm(34), set the same #of threads for both cases and check if that will help to see the same output.

Do you mean iparm(33)? -

seredzhinov__renat — Tue, 11 Dec 2018 11:24:48 GMT

Do you mean iparm(33)? - optimal number of OpenMP threads for conditional numerical reproducibility (CNR) mode. Now _iparm33 = 1 for both cases.

Gennady,

seredzhinov__renat — Wed, 12 Dec 2018 05:51:00 GMT

Gennady,

I prepared the initial data files and the source files. JMatrix.csv is Jacobian, PowerUnbalance.csv is rhs vector. The software implementation you will find in PardisoProvider.cpp. You have to use

int Initialization(int n, int nrhs, Monitel::MathNative::Pardiso::Block2x2 * a, int * ja, int * ia, float *executionTime);

int Factorization(int n, Monitel::MathNative::Pardiso::Block2x2 * a, int * ja, int * ia, float *converterTime, float *factorizationTime, int PivotingPerturbation = 13);

and

int Solve(double * rhs, double * solution, float *executionTime);

in order to reproduce bug.

I suppose we solve the

seredzhinov__renat — Wed, 12 Dec 2018 06:58:00 GMT

I suppose we solved the problem. We added to

case DLL_PROCESS_ATTACH:

the next code:

#if defined (_WIN64)
_set_FMA3_enable(0);
#endif

Renat, how could we build the

Gennady_F_Intel — Wed, 12 Dec 2018 10:29:25 GMT

Renat, how could we build the sources you shared into post#6?

We use Microsoft Visual

seredzhinov__renat — Wed, 12 Dec 2018 11:19:08 GMT

We use Microsoft Visual Studio 2017 (v.15.9.2). The platform toolset is v141. You have to add links to addational files in \include and \lib folders in order to use PardisoProvider::ConvertMatrix method. We use MKL static libraries (mkl_intel_lp64.lib
mkl_intel_thread.lib
mkl_core.lib), but you could use "Use Intel MKL" property for using MKL in the app. I have attached PerfCounter.h and PerfCounter.cpp also. It's necessary for PardisoProvider.cpp.

Gennady,

seredzhinov__renat — Wed, 19 Dec 2018 05:53:29 GMT

Gennady,

did you manage to build a project?

I couldn't build these

Gennady_F_Intel — Wed, 19 Dec 2018 09:07:07 GMT

I couldn't build these project. There is not main function into sources you sent. Is that possible to simplify the case? reading from scv file into CSR format and calling pardiso...

Ок, I'll prepare it.

seredzhinov__renat — Wed, 19 Dec 2018 12:10:00 GMT

Ок, I'll prepare it.

Gennady,

seredzhinov__renat — Mon, 24 Dec 2018 10:13:42 GMT

Gennady,

I have attached a simple project to reproduce the bug. It contains all necessary files. Please, run an executable file on Haswell and Ivy Bridge. The result will be in "result.csv".

thanks, we will try this

Gennady_F_Intel — Tue, 25 Dec 2018 04:36:39 GMT

thanks, we will try this