LLAMA2 on Intel ARC A770

[Mainuzzaman]

Is it possible to use llama2 7b chat model in my Intel Arc A770 GPU? I Installed the driver but unable to use the GPU to load the model. Is there any source available where I can get that help? I installed the oneAPI Base tookit of Intel(I'm Using Windows 11).

[Andres_Intel]

Hello Mainuzzaman,

Thank you for posting on the Intel®️ communities. I know how important is for you to know if is possible to use Llama 2 with your Intel® Arc™ A770 Graphics, I will be happy to help you.  

To understand the situation in a better way, please answer the following questions: 

• Do you receive an error message? If so, take a screenshot of it.
• Provide a detailed explanation of the issue. I understand you want to know if it is possible to use the graphics card with Llama 2, but what happens when you try to launch it? For example, it closes, it freezes, etc.
• Did it work at any moment?
• To know your system environment, attach the report for the following tool Intel® System Support Utility for Windows (SSU), you can find the steps on the link How to get the Intel® System Support Utility Logs on Windows.

Regards,  

Andres P. 

Intel Customer Support Technician 

[Andres_Intel]

Hello Mainuzzaman,

Were you able to run and generate the Intel® SSU the report?   

Let us know if you still need assistance.    

Best regards,   

Andres P.   

Intel Customer Support Technician 

[Andres_Intel]

Hello Mainuzzaman,

We have not heard back from you, so we will close this thread. If you need any additional information, please submit a new question as this thread will no longer be monitored.  

Best regards, 

Intel Customer Support Technician