Intel® oneAPI Math Kernel Library
Ask questions and share information with other developers who use Intel® Math Kernel Library.
7220 Discussions

Failure running stable-diffusion.cpp using oneapi libs

heapify
Beginner
714 Views

Hi, basically the issue is this:

https://github.com/leejet/stable-diffusion.cpp/issues/542

This software used to build and run alright on ubuntu2204 (even as python wrapper), until i had to uninstall a bunch of libmkl* ubuntu packages, as they were going to conflict with oneapi ones when building llama.cpp.

At this point, stable-diffusion.cpp, that is also based on the ggml library, stopped working.
I tried to clean/rebuild, but, although the build is successful, i keep getting that runtime error about missing kernel.

I am asking here because the only  difference is that i removed system libmkl.
Note: i am currently able to build and run both whisper.cpp and llama.cpp, two other projects based on the ggml library

Labels (1)
0 Kudos
3 Replies
Ruqiu_C_Intel
Moderator
666 Views

Although ggml itself is an independent library, when efficient mathematical calculations are required, libmkl can improve the performance.

Please double check and confirm your projects don't use Intel oneMKL library. Also you mentioned that there was conflict with oneAPI, can you tell us which oneAPI components are using in your project, and what's CPU platform target to run on? 

0 Kudos
heapify
Beginner
642 Views

Hi and thanks for the reply, i dug a bit deeper, and i came to the conclusion that the recent oneapi lib update must have broken the software.

The reason is that the build that used to work suddenly started to throw that error . I just did not catch it right away as i wasn't using that software regularly.

It feels it might be a problem with the compiler, as it's seems an issue with templates

i also tried to comment out what seemed the offending codepath related to half floats, and now i get a different issue as i explained here:
https://github.com/leejet/stable-diffusion.cpp/issues/542#issuecomment-2567600648

as that project (https://github.com/leejet/stable-diffusion.cpp) seems relatively straightforward to build and run

(essentially cmake .. -DSD_SYCL=ON -DCMAKE_C_COMPILER=icx -DCMAKE_CXX_COMPILER=icpx, cmake --build . --config Release, ./bin/sd -m <model path>  -p "a cute kitty"), would anyone at intel be able to reproduce this issue?

My problem to verify when the issue started is that i don't know what was the previous oneapi package version i should try to check if thats the reason. But i can say, for example, that 11/29/2024 the system was up to date and able to build and run the software.

0 Kudos
Ruqiu_C_Intel
Moderator
560 Views

It feels it might be a problem with the compiler, as it's seems an issue with templates


Can you help confirm the problem caused by Intel icpx? for example, whether other compilers work well, only Intel icpx failed.

Also, it's always helpful if you can provide out a simple reproducer. If it does an issue from Intel compiler, then Intel compiler experts will investigate it and help you. 

0 Kudos
Reply