Intel® oneAPI Math Kernel Library
Ask questions and share information with other developers who use Intel® Math Kernel Library.
6956 Discussions

MKL for Java Packaging and Speed Improvement

richard_obrien
Beginner
350 Views

Greetings Intel Math Kernal Library Development Team,

I was disappointed with the packaging of the MKL Java JNI. Firstly the files were in an examples folder. The JNI interface really does not belong there.

Secondly it required an MS Visual Studio or Intel compiler. This is not necessary. Id expect a .jar of the compiled classes and three or four of the standard processor/platform library files (mkl_java_stubs_winx64.dll, mkl_java_stubs_winx86.dll or mkl_java_stubs.so).

I was able to get my hands a bit dirty with the source though and found that I could significantly reduce JNI call runtime by simply changing the array accessing methods to use GetPrimitiveArrayCritical.

That is, this tells the Java VM to pin the address space so the DLL can access array contents directly rather than through a copy of the data.

For instance this could be done in CBLAS_gemm.h like this (changes bold):

/*

* Class: com_intel_mkl_CBLAS

* Method: sgemm, or dgemm

*/

JNIEXPORT void JNICALL NAME_JNI_REAL_CRITICAL(JNIEnv *env, jclass klass,

jint Order, jint TransA, jint TransB, jint M, jint N, jint K,

DATA_SCALAR alpha, DATA_VECTOR A, jint lda, DATA_VECTOR B, jint ldb,

DATA_SCALAR beta, DATA_VECTOR C, jint ldc)

{

DATA_SCALAR *aElems, *bElems, *cElems;

aElems = (DATA_SCALAR*)(*env)->GetPrimitiveArrayCritical(env,A,NULL);

bElems = (DATA_SCALAR*)(*env)->GetPrimitiveArrayCritical(env,B,NULL);

cElems = (DATA_SCALAR*)(*env)->GetPrimitiveArrayCritical(env,C,NULL);

assert(aElems && bElems && cElems);

NAME_MKL_REAL((CBLAS_ORDER)Order,(CBLAS_TRANSPOSE)TransA,(CBLAS_TRANSPOSE)TransB,

(int)M,(int)N,(int)K,alpha,aElems,(int)lda,bElems,(int)ldb,beta,cElems,(int)ldc);

(*env)->ReleasePrimitiveArrayCritical(env,C,cElems,0);

(*env)->ReleasePrimitiveArrayCritical(env,B,bElems,JNI_ABORT);

(*env)->ReleasePrimitiveArrayCritical(env,A,aElems,JNI_ABORT);

}

Depending on the matrix size, I achieved a reduction in runtime up to 25% in dgemm. GetPrimitiveArrayCritical may halt GarbageCollection so in theory should be avoided for really long calculations. So it may be better to offer both versions, something like dgemm and dgemmCRITICAL.

If a Java coder has sought out the MKL JNI she is probably seeking better performance than what the open source Java implementations provide. Disabling the memcopy aspect of MKL's JNI parameter passing is low hanging fruit that will improve performance and help close the Java to C performance gap when using these libraries.



0 Kudos
1 Reply
Todd_R_Intel
Employee
350 Views
Richard,

Thanks for posting this note. It sounds like we could make some nice improvements to our Java examples.

We don't consider this a Java interface forIntelMKL. If we billed it as an interface for MKL it wouldcertainly come in a different form. This set of source and build filesis presentas an example of one way to start using Intel MKL from Java.

Again, thanks for the suggestions.

Todd
0 Kudos
Reply