SGEMV bf16/int8 support - Intel Community

Intel® oneAPI Math Kernel Library

Ask questions and share information with other developers who use Intel® Math Kernel Library.

SGEMV bf16/int8 support

366 Views

Is there any support for sgemv int8/bf16 in mkl?

In mkl_blas.h file I was not able to find any apis for bf16/int8 sgemv ,Is there any reason of not having the int8sgemv kernel?

Link Copied

1 Reply

249 Views

Hi, current int8/bf16 support is only for gemm function. gemv does not support it.

Is this request for CPU or GPU? any usage case that need int8/bf16 support for oneMKL?

thanks,
Chao

Copy link

Community support is provided Monday to Friday. Other contact methods are available here.

Intel does not verify all solutions, including but not limited to any file transfers that may appear in this community. Accordingly, Intel disclaims all express and implied warranties, including without limitation, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement, as well as any warranty arising from course of performance, course of dealing, or usage in trade.

For more complete information about compiler optimizations, see our Optimization Notice.