topic Hi Su, Jing-Jung, in Intel® oneAPI Math Kernel Library

FFT 3D does not work after upgrade to mkl 2019

su__jing-jung — Thu, 07 Nov 2019 18:16:47 GMT

Upgraded from mkl 11.0.4 to 2019, the DftiComputeForward & DftiComputeBackward calls failed on 3d (2d is OK), source code as below:

--- initialize

m_inputImage = (mkl_float_complex*)MKL_malloc(sizeof(mkl_float_complex) * mnq, alignSize);
memset(m_inputImage, 0, sizeof(mkl_float_complex)*mnq);

   long statusMKL;
   statusMKL = DftiCreateDescriptor( &LogGaborMKLDescriptor_Forward, DFTI_SINGLE,DFTI_COMPLEX, 3, len);
   if (! DftiErrorClass(statusMKL, DFTI_NO_ERROR)) return FALSE;

   long stride_in[4];
   stride_in[0] = 0; stride_in[1] = 1; stride_in[2] = m; stride_in[3] = m*n;
   statusMKL = DftiSetValue(LogGaborMKLDescriptor_Forward, DFTI_INPUT_STRIDES, stride_in);

statusMKL = DftiCommitDescriptor(LogGaborMKLDescriptor_Forward);
if (! DftiErrorClass(statusMKL, DFTI_NO_ERROR)) return FALSE;

--- call

long statusMKL = DftiComputeForward(LogGaborMKLDescriptor_Forward, m_inputImage);

--------------

Debug shows an error code 9 (DFTI_1D_LENGTH_EXCEEDS_INT32 ) from DftiCommitDescriptor.

Our code is linking with these libraries: mkl_core_dll.lib;mkl_intel_lp64_dll.lib;mkl_intel_thread_dll.lib

Please let me know what I can do to resolve this issue. THANKS.

this symptom (DFTI_1D_LENGTH

Gennady_F_Intel — Fri, 08 Nov 2019 03:24:53 GMT

this symptom (DFTI_1D_LENGTH_EXCEEDS_INT32 ) shows that the input problem sizes are big and you may try to relink with ILP64 API.

Thanks for reply. Replaced

su__jing-jung — Tue, 12 Nov 2019 23:01:38 GMT

Thanks for reply. Replaced with mkl_intel_ilp64_dll.lib does not work, still gets the same error at memory init time. What else I need to change to pass this error?

could you give us the

Gennady_F_Intel — Wed, 13 Nov 2019 03:20:45 GMT

could you give us the simplest reproducer which we could build and run on our side?

Include a TestMKL.zip file

su__jing-jung — Wed, 13 Nov 2019 21:35:09 GMT

Include a TestMKL.zip file that can be extract into a full C++ solution showing the initialization problem. THANKS.

I don't see if you use /MKL

Gennady_F_Intel — Thu, 14 Nov 2019 08:55:33 GMT

I don't see if you use /MKL_ILP64 option when linked the case against ILP64 bits

/Yu"pch.h" /GS /W3 /Zc:wchar_t /I".\..\mkl\include" /I"C:\Program Files (x86)\Visual Leak Detector\include" /ZI /Gm /Od /sdl /Fd"x64\Debug\vc140.pdb" /Zc:inline /D "_DEBUG" /D "_CONSOLE" /D "_UNICODE" /D "UNICODE" /errorReport:prompt /WX- /Zc:forScope /RTC1 /Gd /MDd /Fa"x64\Debug\" /EHsc /nologo /Fo"x64\Debug\" /Fp"x64\Debug\TestMKL.pch"

I use VS 2017 to build the

su__jing-jung — Thu, 14 Nov 2019 15:49:50 GMT

I use VS 2017 to build the solution, the Command Line property is as below.

/OUT:"C:\Dev\Test\TestMKL\x64\Debug\TestMKL.exe" /MANIFEST /NXCOMPAT /PDB:"C:\Dev\Test\TestMKL\x64\Debug\TestMKL.pdb" /DYNAMICBASE "mkl_core_dll.lib" "mkl_intel_ilp64_dll.lib" "mkl_intel_thread_dll.lib" "kernel32.lib" "user32.lib" "gdi32.lib" "winspool.lib" "comdlg32.lib" "advapi32.lib" "shell32.lib" "ole32.lib" "oleaut32.lib" "uuid.lib" "odbc32.lib" "odbccp32.lib" /DEBUG /MACHINE:X64 /INCREMENTAL /PGD:"C:\Dev\Test\TestMKL\x64\Debug\TestMKL.pgd" /SUBSYSTEM:CONSOLE /MANIFESTUAC:"level='asInvoker' uiAccess='false'" /ManifestFile:"x64\Debug\TestMKL.exe.intermediate.manifest" /ERRORREPORT:PROMPT /NOLOGO /LIBPATH:"../mkl/x64/lib" /LIBPATH:"C:\Program Files (x86)\Visual Leak Detector\lib\Win64" /TLBID:1

The code worked in V11.0.4 and earlier version with linking to mkl_intel_lp64_dll.lib and mkl_core_dll.lib, mkl_intel_thread_dll.lib .

yes, I also checked the

Gennady_F_Intel — Fri, 15 Nov 2019 01:04:27 GMT

yes, I also checked the linking options. here everything is correct, but you need to add MKL_ILP64 to the compiler option. Please check MKL developer Guide for more details or look at the MKL Linker adviser tips

Added MKL_ILP64 to compiler

su__jing-jung — Fri, 15 Nov 2019 20:19:21 GMT

Added MKL_ILP64 to compiler option, still receive the same error.

/JMC /permissive- /Yu"pch.h" /GS /W3 /Zc:wchar_t /I".\..\mkl\include" /I"C:\Program Files (x86)\Visual Leak Detector\include" /ZI /Gm- /Od /sdl /Fd"x64\Debug\vc141.pdb" /Zc:inline /fp:precise /D "_DEBUG" /D "_CONSOLE" /D "MKL_ILP64" /D "_WINDOWS" /D "WIN64" /D "_UNICODE" /D "UNICODE" /errorReport:prompt /WX- /Zc:forScope /RTC1 /Gd /MDd /FC /Fa"x64\Debug\" /EHsc /nologo /Fo"x64\Debug\" /Fp"x64\Debug\TestMKL.pch" /diagnostics:classic

Hi Su, Jing-Jung,

Ruqiu_C_Intel — Mon, 25 Nov 2019 08:52:21 GMT

Hi Su, Jing-Jung,

It works well in my site with your package.

Here is my enviroment:(Windows 10; VS 2017(v141); MKL 2019 update 5)

Command Line in VS:

/JMC /permissive- /Yu"pch.h" /GS /W3 /Zc:wchar_t /I".\..\mkl\include" /I"C:\Program Files (x86)\Visual Leak Detector\include" /ZI /Gm- /Od /sdl /Fd"x64\Debug\vc141.pdb" /Zc:inline /fp:precise /D "_DEBUG" /D "_CONSOLE" /D "_UNICODE" /D "UNICODE" /errorReport:prompt /WX- /Zc:forScope /RTC1 /Gd /MDd /FC /Fa"x64\Debug\" /EHsc /nologo /Fo"x64\Debug\" /Fp"x64\Debug\TestMKL.pch" /diagnostics:classic

Hi, Ruqiu, Thank you. Your

su__jing-jung — Thu, 05 Dec 2019 22:13:15 GMT

Hi, Ruqiu, Thank you. Your command line does not have /D "MKL_ILP64" and still working? There must be a small different in your project that ours did not have. What do you think that can be? Our code has be in production for years, really need to resolve this problem.

We are also on Windows 10, VS 2017. The test solution package I gave to you includes all the MKL libraries we linked to has file version 1019.0.5.1. When I run with debug, the output shows only mkl_def.dll is loaded.

---

'TestMKL.exe' (Win32): Loaded 'C:\Dev\Test\TestMKL\x64\Debug\TestMKL.exe'. Symbols loaded.
'TestMKL.exe' (Win32): Loaded 'C:\Windows\System32\ntdll.dll'. Cannot find or open the PDB file.
'TestMKL.exe' (Win32): Loaded 'C:\Windows\System32\kernel32.dll'. Cannot find or open the PDB file.
'TestMKL.exe' (Win32): Loaded 'C:\Windows\System32\KernelBase.dll'. Cannot find or open the PDB file.
'TestMKL.exe' (Win32): Loaded 'C:\Dev\Test\TestMKL\x64\Debug\mkl_core.dll'. Module was built without symbols.
'TestMKL.exe' (Win32): Loaded 'C:\Dev\Test\TestMKL\x64\Debug\mkl_intel_thread.dll'. Module was built without symbols.
'TestMKL.exe' (Win32): Loaded 'C:\Windows\System32\msvcp140d.dll'. Cannot find or open the PDB file.
'TestMKL.exe' (Win32): Loaded 'C:\Windows\System32\vcruntime140d.dll'. Cannot find or open the PDB file.
'TestMKL.exe' (Win32): Loaded 'C:\Windows\System32\ucrtbased.dll'. Cannot find or open the PDB file.
'TestMKL.exe' (Win32): Loaded 'C:\Program Files (x86)\Common Files\Intel\Shared Libraries\redist\intel64_win\compiler\libiomp5md.dll'. Symbols loaded.
The thread 0x34f08 has exited with code 0 (0x0).
'TestMKL.exe' (Win32): Loaded 'C:\Program Files (x86)\Common Files\Intel\Shared Libraries\redist\intel64_win\mpirt\libimalloc.dll'. Cannot find or open the PDB file.
'TestMKL.exe' (Win32): Unloaded 'C:\Program Files (x86)\Common Files\Intel\Shared Libraries\redist\intel64_win\mpirt\libimalloc.dll'
'TestMKL.exe' (Win32): Loaded 'C:\Program Files (x86)\Common Files\Intel\Shared Libraries\redist\intel64_win\mpirt\libimalloc.dll'. Cannot find or open the PDB file.
'TestMKL.exe' (Win32): Unloaded 'C:\Program Files (x86)\Common Files\Intel\Shared Libraries\redist\intel64_win\mpirt\libimalloc.dll'
'TestMKL.exe' (Win32): Loaded 'C:\Dev\Test\TestMKL\x64\Debug\mkl_def.dll'. Module was built without symbols.
'TestMKL.exe' (Win32): Loaded 'C:\Windows\System32\kernel.appcore.dll'. Cannot find or open the PDB file.
'TestMKL.exe' (Win32): Loaded 'C:\Windows\System32\msvcrt.dll'. Cannot find or open the PDB file.
'TestMKL.exe' (Win32): Loaded 'C:\Windows\System32\rpcrt4.dll'. Cannot find or open the PDB file.
The thread 0x3564c has exited with code 0 (0x0).
The thread 0x3550c has exited with code 0 (0x0).
The program '[0x34630] TestMKL.exe' has exited with code 0 (0x0).
-

Result:

DftiCommitDescriptor error = DFTI_1D_LENGTH_EXCEEDS_INT32
Status = FAILED