Intel® oneAPI DPC++/C++ Compiler
Talk to fellow users of Intel® oneAPI DPC++/C++ Compiler and companion tools like Intel® oneAPI DPC++ Library, Intel® DPC++ Compatibility Tool, and Intel® Distribution for GDB*
789 Discussions

Does IPEX-LLM Ollama run on a pc with an AMD 8700f CPU and an ARC 770 16GB GPU?

IPEX-LLM-fan
Beginner
2,843 Views

Dear Intel developers

 

I have a pc with an eagle-ax 650b motherboard and an and 8700f cpu and an intel ARC 770 16GB predator GPU running ubuntu.  

 

I tried installing IPEX-LLM ollama on it.    I filed a bug report here: https://github.com/intel/ipex-llm/issues/13223#issuecomment-2982318913  on the problems and crash I had doing this.   One of the github community kindly commented on it and said they thought IPEX LLM only worked when the pc was running an intel CPU......   Will it work OK with my hybrid AMD CPU Intel GPU combo?

 

Comments appreciated.

 

PS If I can make the acceleration work with the LLMs I am using I am going to buy second GPU and run them in parallel.

 

Cheers

 

Regards

 

Michael Fothergill

https://www.linkedin.com/in/michael-fothergill-65525633/?trk=eml-email_notification_digest_01-header-0-profile_glimmer

0 Kudos
1 Solution
IPEX-LLM-fan
Beginner
2,595 Views

Many thanks for your response.  The issue is now resolved.   I reinstalled oneapi and ipex-llm ollama following Intels Graphics installation page recommendations and now ipex-llm works.   I posted the bug fix as an addendum to the bug report you see in my original post.   

 

Cheers

 

MF

View solution in original post

0 Kudos
2 Replies
yzh_intel
Moderator
2,600 Views

I don't know if we have ipex-llm expert on this forum, do you have any specific issue with either sycl, dpc++ compiler etc ? 

0 Kudos
IPEX-LLM-fan
Beginner
2,596 Views

Many thanks for your response.  The issue is now resolved.   I reinstalled oneapi and ipex-llm ollama following Intels Graphics installation page recommendations and now ipex-llm works.   I posted the bug fix as an addendum to the bug report you see in my original post.   

 

Cheers

 

MF

0 Kudos
Reply