topic Problem with MKL 10 update 3 and newer versions in Intel® oneAPI Math Kernel Library

Problem with MKL 10 update 3 and newer versions

jpeinado — Thu, 09 Jun 2011 10:48:49 GMT

Hi:

I am working in a program using LINUX (64 bits) and MATLAB R2010b, CUDA and CULA (environments to use GPUs) and MKL.

Before, when working with MKL 10 update 2, all worked well. Now, when working with last version of MKL, I have a runtime error....It seems a MKL problem:

*** libmkl_mc3.so *** failed with error : /opt/intel/composerxe-2011.1.107/mkl/lib/intel64/libmkl_mc3.so: undefined symbol: i_free
*** libmkl_def.so *** failed with error : /opt/intel/composerxe-2011.1.107/mkl/lib/intel64/libmkl_def.so: undefined symbol: i_free
MKL FATAL ERROR: Cannot load neither libmkl_mc3.so nor libmkl_def.so

I read some about this (I think it is a similar problem) here: http://software.intel.com/en-us/forums/showthread.php?t=60460

but I don't understand what must I do to solve the problem. Now, I include the following libraries:

-lmkl_core -lmkl_intel_lp64 -lmkl_intel_thread -liomp5

What must I change? Couuld you give me a line telling me the libraries to include?

Thank you very much

jpeinado

Problem with MKL 10 update 3 and newer versions

Gennady_F_Intel — Thu, 09 Jun 2011 11:02:29 GMT

do you mean that with 10.0 Update2 all worked well. right? and which version of mkl you use now?

Problem with MKL 10 update 3 and newer versions

barragan_villanueva_ — Thu, 09 Jun 2011 11:17:02 GMT

Quoting jpeinado@gmail.com

...Now, I include the following libraries:

-lmkl_core -lmkl_intel_lp64 -lmkl_intel_thread -liomp5

Hi,

This MKL libraries are in incorrect order and not grouped :(
Please use Intel MKL Link Line Advisorfor help.
It recommends:
-L$(MKLROOT)/lib/intel64 -Wl,--start-group -lmkl_intel_lp64 -lmkl_intel_thread -lmkl_core -Wl,--end-group -openmp -lpthread

Problem with MKL 10 update 3 and newer versions

jpeinado — Thu, 09 Jun 2011 13:37:16 GMT

Thank you very much Victor (I didnt know the MKL Advisor). The problem with your advice, is that I use this in a MATLAB MEX command:

Usage:

MEX [option1 ... optionN] sourcefile1 [... sourcefileN]

[objectfile1 ... objectfileN] [libraryfile1 ... libraryfileN]

Usage: MEX [option1 ... optionN] sourcefile1 [... sourcefileN] [objectfile1 ... objectfileN] [libraryfile1 ... libraryfileN]

Then, I cant use options as start/end group or -openmp...I have to put the exact library (objectfile) name. Is this possible?

Thanks

jpeinado

Problem with MKL 10 update 3 and newer versions

TimP — Thu, 09 Jun 2011 14:44:17 GMT

The start-group/end-group directives are taken by gnu ld. If you are compiling on a linux system, there should be no reason why you can't use them. If you don't want to use them, you can use the .so libraries (ask link advisor about dynamic libraries), or you can repeat the .a library list several times (e.g. 3 times, if you use the proper order).

Problem with MKL 10 update 3 and newer versions

VipinKumar_E_Intel — Thu, 09 Jun 2011 14:54:32 GMT

Please also refer the thread on start-group/end-group symbols

http://software.intel.com/en-us/forums/showthread.php?t=83330&o=a&s=lr

--Vipin

Problem with MKL 10 update 3 and newer versions

jpeinado — Thu, 09 Jun 2011 16:58:12 GMT

The problem is that I am using the MATLAB MEX command. I don't know why the MEX command don't know the start-group/end group directives. Anyway, I have not experience with the link advisor. Could you please write for me the exact name and order of libraries? I apologize for given too much work but I have no idea of how to do it. By the way, MATLAB needs dynamic libraries

Thank you very much

jpeinado

Problem with MKL 10 update 3 and newer versions

jpeinado — Thu, 09 Jun 2011 20:20:35 GMT

Hi again:

I learnt to use the Linker Line Advisor with MEX MATLAB compiler and now it compiles OK:

I used this line got wit the MKL Linker Line Advisor:

-L$(MKLROOT)/lib/intel64 -Wl,--start-group -lmkl_intel_ilp64 -lmkl_intel_thread -lmkl_core -Wl,--end-group -liomp5 -lpthread

but I have the same results when running my program:

*** libmkl_mc3.so *** failed with error : /opt/intel/composerxe-2011.1.107/mkl/lib/intel64/libmkl_mc3.so: undefined symbol: i_free

*** libmkl_def.so *** failed with error : /opt/intel/composerxe-2011.1.107/mkl/lib/intel64/libmkl_def.so: undefined symbol: i_free

MKL FATAL ERROR: Cannot load neither libmkl_mc3.so nor libmkl_def.so

*** libmkl_mc3.so *** failed with error : /opt/intel/composerxe-2011.1.107/mkl/lib/intel64/libmkl_mc3.so: undefined symbol: i_free*** libmkl_def.so *** failed with error : /opt/intel/composerxe-2011.1.107/mkl/lib/intel64/libmkl_def.so: undefined symbol: i_freeMKL FATAL ERROR: Cannot load neither libmkl_mc3.so nor libmkl_def.so

What is happening?

Thank you very much

jpeinado

Problem with MKL 10 update 3 and newer versions

AndrewC — Fri, 10 Jun 2011 02:01:03 GMT

Hi,
Your problems with Matlab can be due to conflicts with Matlabs MKL DLL/.so ( Matlab uses MKL but an older version). This caused me a lot of grief!

But...you can avoid all these problems by building a "custom" MKL DLL using the tools/builder makefiles (found in the MKL area). It is really easy and you end up with one DLL/.so to link against. And there is no conflict with the Matlab MKL DLL's/.so as your dll has a different name....

This also helps a lot when building a MKL extension to Python as well.

Andrew

Problem with MKL 10 update 3 and newer versions

jpeinado — Fri, 10 Jun 2011 03:46:15 GMT

Hi:

The strange thing is that MKL 10 Update 2 works OK, but update 3 does not work. Could you explain me how to do that please?

By theway. Is there any way to know the MKL version of my MATLAB copy

Thank you very much

jpeinado

Problem with MKL 10 update 3 and newer versions

AndrewC — Fri, 10 Jun 2011 03:53:26 GMT

I can't explain why changes in MKL upset Matlab. But I do know that creating a custom DLL will probably solve your problem.
Creating a custom DLL is easier than creating a MEX file!

cd /opt/intel/composerxe-2011.3.174/mkl/tools/builder

make sointel64 export=lapack_list name=libMyMKL

Then link your MEX file against libMyMKL.so

Problem with MKL 10 update 3 and newer versions

jpeinado — Fri, 10 Jun 2011 07:38:33 GMT

Hi:

I did what you told me and almost work....but

make sointel64 export=blas_list name=libMyblas

The problem now is:

dgeidreplpa_cu.o: In function `mexFunction':
tmpxft_000045b0_00000000-1_dgeidreplpa_cu.cudafe1.cpp:(.text+0x142e): undefined reference to `idamax'
tmpxft_000045b0_00000000-1_dgeidreplpa_cu.cudafe1.cpp:(.text+0x150d): undefined reference to `idamax'
collect2: ld returned 1 exit status

mex: link of ' "dgeidreplpa_cu.mexa64"' failed.

nm libMyblas.so |grep "idamax"
U idamax_

The "typical" problem of "_"

How can I solve this?

Thank you

jpeinado

Problem with MKL 10 update 3 and newer versions

TimP — Fri, 10 Jun 2011 14:44:42 GMT

Well, yes, if you wish to call idamax directly from C with Fortran style parameters, you must spell it idamax_
I suppose there is a cblas wrapper as well.

Problem with MKL 10 update 3 and newer versions

AndrewC — Fri, 10 Jun 2011 17:47:28 GMT

Make a copy of blas_list ( call it my_blas_list) and add one line with "idamax" to the end of my_blas_list

then do...

make sointel64 export=my_blas_list name=libMyblas

See if that works...

Problem with MKL 10 update 3 and newer versions

AndrewC — Fri, 10 Jun 2011 17:49:52 GMT

Yup good point by Tim, just concatenate blas_list and cblas_list together into my_blas_list and call cblas_idamax instead.

Problem with MKL 10 update 3 and newer versions

jpeinado — Fri, 10 Jun 2011 23:16:53 GMT

There is a cblas_wrapper but the function it is called cblas_idamax....I dont understand this, because it works with the original MKL . I would try it the idea of creating my own blas list. I will do this on Monday, and inform you as soon as possible.

Thank you very much

jpeinado

Problem with MKL 10 update 3 and newer versions

jpeinado — Fri, 10 Jun 2011 23:53:12 GMT

I did this:

Make a copy of blas_list ( call it my_blas_list) and add one line with "idamax" to the end of my_blas_list

then do...

make sointel64 export=my_blas_list name=libMyblas

See if that works...

But it does not work

dgeidreplpa_cu.o: In function `mexFunction':

tmpxft_00005d80_00000000-1_dgeidreplpa_cu.cudafe1.cpp:(.text+0x142e): undefined reference to `idamax'

tmpxft_00005d80_00000000-1_dgeidreplpa_cu.cudafe1.cpp:(.text+0x150d): undefined reference to `idamax'

collect2: ld returned 1 exit status

mex: link of ' "dgeidreplpa_cu.mexa64"' failed.

dgeidreplpa_cu.o: In function `mexFunction':tmpxft_00005d80_00000000-1_dgeidreplpa_cu.cudafe1.cpp:(.text+0x142e): undefined reference to `idamax'tmpxft_00005d80_00000000-1_dgeidreplpa_cu.cudafe1.cpp:(.text+0x150d): undefined reference to `idamax'collect2: ld returned 1 exit status
mex: link of ' "dgeidreplpa_cu.mexa64"' failed.

If I do nm |libMyblas.so the function is found.....

I dont understand why the original MKL library finds "idamax" but muy built library only find "idamax_"

Problem with MKL 10 update 3 and newer versions

AndrewC — Sat, 11 Jun 2011 00:45:05 GMT

I think you need to double check you are linking against the correct libMyblas.so ( the one created with the extra idamax), as it works for me.

Anyway, don't get hung up on this. I assume you have the source code to the MEX , change reference to idamax to idamax_ and move on.

Problem with MKL 10 update 3 and newer versions

jpeinado — Sat, 11 Jun 2011 06:12:25 GMT

Hi:

Thank you very much for your fast answer. Later, I am going to go to my University Office (today On saturday) because I am very interested in solve this :-)

As you told me, I will try again to link against my correct libMyBlas.so and later, I will change my MEX source code (you are right, I have it) and will change idamax to idamax_

Thank you again for your patience with me.

jpeinado

Problem with MKL 10 update 3 and newer versions

AndrewC — Sat, 11 Jun 2011 06:20:54 GMT

Just to be clear, your mex command line will be something like ( I forget exact mex syntax on Linux). You do not include any other MKL libraries.

mex mymexfile.c -I -lMyBlas