I'm interested to get more details on the performance characteristics of the function cblas_gemm_s16s16s32. In my application, the performance gain over cblas_sgemm is lower than I would hope.
Here is my test configuration, which is larger than what would typically be used in my application (a seq2seq model):
And here are some single threaded results on a Intel(R) Core(TM) i7-6700K (AVX2), averaged over 1000 samples:
Are these values expected? Do I need to do something specific to get more performance out of cblas_gemm_s16s16s32?
For more complete information about compiler optimizations, see our Optimization Notice.