topic Re: SGEMV bf16/int8 support in Intel® oneAPI Math Kernel Library

SGEMV bf16/int8 support

arunak — Fri, 18 Oct 2024 05:13:45 GMT

Is there any support for sgemv int8/bf16 in mkl?

In mkl_blas.h file I was not able to find any apis for bf16/int8 sgemv ,Is there any reason of not having the int8sgemv kernel?

Chao_Y_Intel — Fri, 25 Oct 2024 08:26:35 GMT

Hi, current int8/bf16 support is only for gemm function. gemv does not support it.

Is this request for CPU or GPU? any usage case that need int8/bf16 support for oneMKL?

thanks,
Chao