Ollama on intel arc 750

[YOUSUF_A750]

I can't use the GPU Intel arc a750 for ollama model, I was just tried to working on codellama.
My System:
  1. intel corei5 12400f
  2. intel arc a750 
      driver version: 32.0.101.6299
  3. Windows 11 pro

I followed some resources:
     1. https://github.com/mattcurf/ollama-intel-gpu

     2. Running Ollama with Open WebUI on Intel Hardware Platform 
this was form intel site , but it didn't work for me . still used my cpu rather than the GPU
     3. https://dev.to/itlackey/run-ollama-on-intel-arc-gpu-ipex-4e4k

and those doesn't did good job , I hope that intel will see this problem and will come with an official solution.

[Mike_Intel]

Hello YOUSUF_A750,

Thank you for posting in Intel community Forum.

For me to further check this, please help provide the following details:

1. Can you tell me more about the issue that you encounter? Are you having errors or is it crashing?
2. Have you tried checking with Ollama for the system requirements?
3. How about your other software or playing games, are you also having issues with your Arc A750?

If you have questions, please let us know. Thank you.

Best regards,

Michael L.

Intel Customer Support Technician

[YOUSUF_A750]

sorry for the late reply.
I  was trying to use Ollama with my GPU intel arc a750.
I find a guideline for intel arc a770 to run ollama with that.
but doesn't get specific guideline for arc a750  gpu. Though I followed some general guideline for Intel gpu to run ollama. that doesn't worked.
when I run ollama , i see my cpu is using to run it , instead of the gpu , I need a solve on that.

my other thing like playing game , video editing  are going good with this GPU.
Kindly give me an specific guideline to run ollama model with the help of my gpu.|
some information for your help:
my system:
1. operating system: windows 11 pro
2. CPU: intel cori5 12400f
3. GPU: intel arc a750.
     driver version: 32.0.101.6299
thanks

[Mike_Intel]

Hello YOUSUF_A750,

Thank you for the update.

Base on the information that you provided, this issue is more on the side of the application/software that you are using.

However, let me further check, kindly provide the following details.

1. Can you share the line of the guide that you mentioned?
2. Can you also share the link of the hardware requirements of the software?
3. Have you tried contacting the support of Ollama regarding this inquiry?

If you have questions, please let us know. Thank you.

Best regards,

Michael L.

Intel Customer Support Technician

[Mike_Intel]

Hello YOUSUF_A750,

I hope this message finds you well. 

Were you able to check the previous post?

Please let us know if you still need assistance.

Best regards,

Michael L.

Intel Customer Support Technician

[YOUSUF_A750]

Further I goes to Ollama community and asked about the solution to run ollama in  intel arc gpu , I got replied that ollama doesn't officially support intel gpu , but they mentioned about third party alternatives/forks can be used. thought they didn't mentioned the process , 

but can intel provide some support on that , like I found an article from intel to give ollama support for intel arc a770 GPU , that PDF is given bellow.
can you provide an support with Ollama like that for intel arc a750 GPU.

Notice: I tried this guideline for my intel arc a750 GPU , but that didn't work.

I also found some resource about solving the issue , thought they didn't worked 🥲

those resources are:

     https://github.com/mattcurf/ollama-intel-gpu

      Running Ollama with Open WebUI on Intel Hardware Platform 

      https://dev.to/itlackey/run-ollama-on-intel-arc-gpu-ipex-4e4k

[Mehr1]

Hi Mike,

Hope you are doing well and enjoyed your weekend so far.

I have a Windows 11 on a mini PC (geekom GT series G1 Mega) and it has the Intel Arc iGPU, + NPU
I also have a local AI chat and my setup is this (Ollama + Docker + Openwebui)
now I want to use my Intel ARC iGPU but no matter what I do, Ollama ends up running on CPU.

I tried the instruction from Intel, the PDF you shared as well but the problem is that the Intel oneAPI Base Toolkit they use in the instructions is version 2024.1.0 but the version available to download now is 2025.1 and it is not working, I mean when I run the "Ollama serve" it is missing some DLLs that I have but in a higher version... and it's a dead end.

So, I wanted to see if there is way:

1- downloading the 2024.1.0 version.

2- or any other way to use for my case, Ollama + Docker + Openwebui, so that the intel Arc iGPU or NPU will be used when I use Ollama in OpenwebUi.

Thank you in advance.

Best

Mehr

[Mike_Intel]

Hello YOUSUF_A750,

Thank you for the update.

If the software does not support the hardware, I think that is the issue.

However, let me see what I can do. Please help generate the SSU logs of your system for me to further check this.

Kindly follow the steps in the link below:

https://www.intel.com/content/www/us/en/support/articles/000057926/memory-and-storage.html

If you have questions, please let us know. Thank you.

Best regards,

Michael L.

Intel Customer Support Technician

[YOUSUF_A750]

There is the SSU logs about my device.
Please let me know further information about this.
I actually need Ollama to run in this GPU. And there are many person who  using this GPU are needed to do same stuff. 

[Mike_Intel]

Hello YOUSUF_A750,

Thank you for the information provided.  

I will do further research on this matter and post the response on this thread once it is available.

Thank you very much for your patience and understanding!

Best regards,

Michael L.

Intel Customer Support Technician

[YOUSUF_A750]

Hi Mike ,
any further update about my issue??
kindly help me fast. because It's very important for me.

[Mike_Intel]

Hello YOUSUF_A750,

While we are checking this, let gather additional information:

1. Did you encounter any error message when trying to use Ollama?
2. Can you share any code samples we can use to investigate the issue?
3. Please help provide a replication steps we can follow for me to try in our lab.

If you have questions, please let us know. Thank you.

@Mehr1

If you need assistance, please create a new thread for us to assist you on your own thread and gather the details of your systems.

Best regards,

Michael L.

Intel Customer Support Technician

[Mehr1]

Hi @Mike_Intel 

I did it and here you can find it:

https://community.intel.com/t5/Intel-ARC-Graphics/Intel-s-DPF-instruction-on-how-to-run-Ollama-on-Intel-Arc-iGPU/m-p/1660873#M19699

I would be more than happy if you would give me a guidance

[Mike_Intel]

Hello YOUSUF_A750,

I hope this message finds you well. 

Were you able to check the previous post?

Please let us know if you still need assistance.

Best regards,

Michael L.

Intel Customer Support Technician

[Mike_Intel]

Hello YOUSUF_A750,

I hope you are having a good day.

I am sending another follow up on the information that I requested. 

Since we have not heard back from you, I need to close this inquiry. 

If you need further assistance, please post a new question as this thread will no longer be monitored. 

Thank you and have a great day. 

Best regards,

Michael L.

Intel Customer Support Technician