topic Re: Do we have plan for sparse matrix for int8? in Intel® oneAPI Math Kernel Library

Do we have plan for sparse matrix for int8?

sakula — Thu, 15 Jun 2023 08:16:21 GMT

When I use pytorch with mkl.

I got addmm_out_sparse_csr_impl_mkl" not implemented for 'Byte' error.

And it seems that sparse.mm doesn't support int8 type.

Re:Do we have plan for sparse matrix for int8?

VarshaS_Intel — Fri, 16 Jun 2023 12:20:40 GMT

Hi,

Thanks for posting in Intel Communities.

Could you please let us know the OS details, Intel Pytorch version, and Intel MKL version you are using?

And also, could you please provide us with the sample reproducer code and the steps you have followed to reproduce the error at our end?

It would be great if you could please elaborate on your issue.

Thanks & Regards,

Varsha

Re: Re:Do we have plan for sparse matrix for int8?

sakula — Fri, 16 Jun 2023 12:37:52 GMT

import torch
a =torch.zeros(128, 12288*4, dtype=torch.uint8)                                                                                                                                                                                                                                                                                                                              
                                                                                                                                                                                                           
a = a.to_sparse_csr()                                                                                                                                                                                      
# b = torch.rand(12288*4, 4096, dtype=torch.int8)                                                                                                                                                          
b = torch.randint(high=255, size=(12288*4,12288), dtype=torch.uint8)                                                                                                                                       
torch.sparse.mm(a,b)

The error is "addmm_out_sparse_csr_impl_mkl" not implemented for 'Byte'

Versions

PyTorch version: 2.0.1+cu117
Is debug build: False
CUDA used to build PyTorch: 11.7
ROCM used to build PyTorch: N/A

OS: CentOS Linux 7 (Core) (x86_64)
GCC version: (GCC) 9.3.0
Clang version: Could not collect
CMake version: version 3.26.3
Libc version: glibc-2.17

MKL version: 2.7.3

oneAPI 2022.2

Versions of relevant libraries:
[pip3] intel-extension-for-pytorch==2.0.100
[pip3] numpy==1.24.1
[pip3] torch==2.0.1
[pip3] torch-scatter==2.1.1
[pip3] torch-sparse==0.6.17
[pip3] torchaudio==2.0.2
[pip3] torchvision==0.15.2
[pip3] triton==2.0.0
[conda] intel-extension-for-pytorch 2.0.100 pypi_0 pypi
[conda] numpy 1.24.1 pypi_0 pypi
[conda] torch 2.0.1 pypi_0 pypi
[conda] torch-scatter 2.1.1 pypi_0 pypi
[conda] torch-sparse 0.6.17 pypi_0 pypi
[conda] torchaudio 2.0.2 pypi_0 pypi
[conda] torchvision 0.15.2 pypi_0 pypi
[conda] triton 2.0.0 pypi_0 pypi

Re: Do we have plan for sparse matrix for int8?

VarshaS_Intel — Thu, 22 Jun 2023 16:01:29 GMT

Hi,

Thanks for the information.

At our end, when we tried to run the sample reproducer code provided by you using Intel Python 3.9, PyTorch 2.0, and Intel MKL(2023.1), we got the following error:

" /root/code.py:4: UserWarning: Sparse CSR tensor support is in beta state. If you miss a functionality in the sparse tensor support, please submit a feature request to https://github.com/pytorch/pytorch/issues. (Triggered internally at /build/pytorch/aten/src/ATen/SparseCsrTensorImpl.cpp:54.)

a = a.to_sparse_csr()".

Please find the below screenshot:

Could you please help with the error and also could you please let us know the steps you followed to reproduce your error?

Thanks & Regards,

Varsha

Re:Do we have plan for sparse matrix for int8?

VarshaS_Intel — Thu, 29 Jun 2023 10:47:10 GMT

Hi,

We have not heard back from you. Could you please provide us with the details and update on your issue?

Thanks & Regards,

Varsha

Re:Do we have plan for sparse matrix for int8?

VarshaS_Intel — Thu, 06 Jul 2023 18:03:47 GMT

Hi,

We have not heard back from you. Could you please provide us with the details and update on your issue?

Thanks & Regards,

Varsha

Re: Do we have plan for sparse matrix for int8?

sakula — Fri, 07 Jul 2023 02:20:24 GMT

Sorry, I have solved this problem with latest pytorch.
Thanks for your help!!

Re:Do we have plan for sparse matrix for int8?

VarshaS_Intel — Fri, 07 Jul 2023 16:53:18 GMT

Hi,

It’s great to know that the issue has been resolved. Thanks for sharing the solution with us. In case you run into any other issues please feel free to create a new thread.

Have a Good Day!

Thanks & Regards,

Varsha