MKL 7.0 (zgemm) performance with small matrices

Intel® oneAPI Math Kernel Library

Ask questions and share information with other developers who use Intel® Math Kernel Library.

MKL 7.0 (zgemm) performance with small matrices

535 Views

I reported this issue with MKL 6.1. Hopefully it is on the enhancement list for MKL 7.X.
I have a general purpose MATRIX library ( Rogue Wave Math.h++) that was easy to retrofit to use MKL. My application uses a wide variety of complex matrix sizes from 6x6 to 500x500.
For small matrices, I took a big performance hit in using MKL due to some obvious overhead in MKL calls.
I ended up having to derive special small matrix classes to call an inline zgemm.
Using Rational Quantify shows the bottleneck to clearly be zgemm in MKL.

Link Copied

0 Replies

Community support is provided Monday to Friday. Other contact methods are available here.

Intel does not verify all solutions, including but not limited to any file transfers that may appear in this community. Accordingly, Intel disclaims all express and implied warranties, including without limitation, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement, as well as any warranty arising from course of performance, course of dealing, or usage in trade.

For more complete information about compiler optimizations, see our Optimization Notice.