Intel's DPF instruction on how to run Ollama on Intel Arc iGPU

[Mehr1]

Hi @Mike_Intel 

Hope you are doing well,
I have a windows 11 on a mini PC (Geekom GT series G1 Mega) and it has the Intel Arc iGPU,
I also have a local AI chat and my setup is this (Ollama + DOcker + Openwebui)

So, whenever I use Ollama models, it is running on my CPU, so I tried to find a way to activate the iGPU and I found a PDF file from Intel.

I followed the instructions and once I was done at the very last step when  I ran "Ollama serve" I got these errors in the PC:

1-

The code execution cannot proceed because
mkl_sycl_blas.4.dll was not found. Reinstalling the program
may fix this problem.

2-

The code execution cannot proceed because sycl7.dll was not
found. Reinstalling the program may fix this problem.

3- 

The code execution cannot proceed because sycl7.dll was not
found. Reinstalling the program may fix this problem.

So, then I rechecked everything and did a lot of research and finally realized that the only difference between the PDF instructions and what I did is that the instruction used "Intel openAPI toolkit version 2024.1.0" but the only version I could find and download to use was version  "2025.0.1.47"
I can see that the errors suggest that the missing DLL files are in different versions because I have all these DLLs in some folders but with higher versions as follows:
mkl_sycl_blas.5.dll
sycl8.dll
ur_win_proxy_loaderd.dll

So now what I am looking for is a way to fix this issue:

1- whether by finding the 2024.1.0 version as it was in the instruction(which I don't know if its going to work)
2- or any other possible way.

Thank you in advance.

Best

Mehr

[JohnM_Intel]

Hello Mehr1, 

Thank you for raising this issue with us. For us to investigate this issue, kindly answer some of my questions below for me to better understand this issue.

1. What is the model of your CPU?
2. What is the current driver version of the graphics?
3. What is the make and model of the mini PC?

Also kindly provide an SSU for me to further check the system information of your unit.

When the download is complete, launch SSU.exe.

1. Scan: Check the box Everything.

2. Click Scan.

3. Review: When finished scanning, click Next.

4. Click Save.

Best regards,

John Sergio M.

Intel Customer Support Technician

[Mehr1]

Hi @JohnM_Intel 

Hope you are doing well, 

- Attached are the screenshots of the GPU and CPU

- And also the SSU info.

- The model of the mini PC is Geekom GT series G1 Mega.

Please let me know what to do, I don't know if you read the case or not but as I mentioned the main difference between what I did and the instructions PDF is the Intel openAPI toolkit version 2024.1.0

Looking forward to hearing back from you.

Best

Nehr

[JohnM_Intel]

Hello Mehr1,

Thank you for providing the details needed for me to provide the best course of action. Allow me enough time to investigate this concern further and do some troubleshooting on my end.

Best regards,

John Sergio M.

Intel Customer Support Technician

[RandyT_Intel]

Hello Mehr1, 

I have reviewed your case and noticed that you previously created a web ticket and were referred to our oneAPI Registration, Download, Licensing, and Installation forum. To ensure you receive the most accurate and timely assistance, we have moved your thread to the appropriate forum.

You can now find your thread under Developer Software Forums.

Randy T. 

Intel Customer Support Technician 

[Mehr1]

so what now? I am still looking for a guidance 

[cyear]

找到旧版本的安装包了吗？我也需要它。

[Mehr1]

no, I didn't find it and the Intel support didn't provide it but I tried this instruction and it worked partly...

https://github.com/mattcurf/ollama-intel-gpu

[cyear]

I found this library, maybe it can solve the problem

pip install onednn-devel==2024.2.1

[cyear]

I successfully made the model run last night

[wxing82]

I figured it out as below:

Add "c:\Windows\System32\llm_env\Library\bin\" this path into the environment variable with below console instruction before running ollama.

set PATH=%PATH%;c:\Windows\System32\llm_env\Library\bin\

Then you should be able to run ollama serve. enjoy!

[RahulC_Intel]

Hi Mehr, we would like to inform you that older versions of Intel® oneAPI toolkit has been removed publicly. Only latest version of Intel® oneAPI toolkit available for users. 

Please note that Intel® has decided that Intel® oneAPI Toolkits Versions: 2024.2.0 and earlier are not supported anymore. We urge users to upgrade to the latest version of Intel® developer tools. The unsupported versions do not include the latest functional and security updates. These versions are targeted to be removed after a period. For more information refer to the link: https://www.intel.com/content/www/us/en/developer/articles/release-notes/oneapi-supported-product-versions.htm, and scroll down to the Unsupported Product Version. 

Intel® oneAPI users with active Intel Priority Support can access older versions via a secure portal you gain access to as part of your support subscription. Kindly refer below link for more details: 

FAQ's Priority Support Link: https://www.intel.com/content/www/us/en/developer/get-help/faq-priority-support.html 

[RahulC_Intel]

Hi Mehr, unfortunately we were unable to hear back from you. 

If you have any further query, please post a new question as this thread will no longer be monitored by Intel®.