Graphics
Intel® graphics drivers and software, compatibility, troubleshooting, performance, and optimization
21471 Discussions

use 2 intel GPU's in one pc to allow bigger LLM models

api
Novice
896 Views

Hi there, i have actually a few questions ...

 

I found out that intel does not support something similar to SLI or xfire .... and the Deep Link function does only support integrated + external GPU ... still true ?

 

If i Install 2 lets say A770 with 16 GB each, can it be used as a 32 GB unit for LLM's ? in Vulcan or so ? maybe even if the second GPU only is used for its Vram ?

 

Can the intel Driver Software on Windows confugure both GPU's ? in terms of reducing the Power consumption, or change the max GPU temperature, etc. ? so basically is the Software center capable of handling 2 A770 in one system ?

 

Thank you very much in advance!!

 

Cheers, T.

0 Kudos
1 Solution
RobbieR_Intel
Moderator
437 Views

Hello api,


I hope you had the opportunity to review the information I posted. If you have further questions, kindly let us know.


Best regards,


Robbie R.

Intel Customer Support Technician


View solution in original post

9 Replies
Stefan3D
Honored Contributor II
833 Views

SLI and Crossfire are meanwhile out-dated technologies for graphics rendering, not necessary for computing.

 

Vulkan compute exists theoretically, but nobody uses it.

In general get familiar with OpenCL - https://www.khronos.org/opencl/

 

 

0 Kudos
api
Novice
803 Views

Sorry but you did not answer any of the questions from above, just providing your opinion

Thank you for the link to OpenCL, but i hope someone will actually read what i wrote and help me with that
Cheers, T.

0 Kudos
RobbieR_Intel
Moderator
724 Views

Hello api,

Thank you for reaching out! We would like to inform you we are currently investigating your inquiry and need more time to further check the details.

Best Regards,

Robbie R.

Intel Customer Support Technician

 

RobbieR_Intel
Moderator
650 Views

Hello api,

 

Thank you for reaching out! Deep link technology currently supports pairing integrated GPU with a discrete GPU. This is a combination of Intel Arc discrete GPU with Intel Iris Xe integrated graphics found in 12th-generation processors or newer. For more information regarding this, please see Does Intel® Arc™ Support Multi-GPU? and Can Two Intel® Arc™ Graphics Cards be Installed and Operated as One Unit?

 

For your question, using 2 Arc GPUs for LLM interfacing is supported using IPEX-LLM. For more information about IPEX-LLM, please see Run IPEX-LLM serving on Multiple Intel GPUs using DeepSpeed AutoTP and FastApi — IPEX-LLM latest documentation.


We look forward to your response!

 

Best regards,

 

Robbie R.

Intel Customer Support Technician


0 Kudos
api
Novice
636 Views

very much for your answers, just one major question is still open 

 

Can the intel Driver Software on Windows confugure both GPU's ? in terms of reducing the Power consumption, or change the max GPU temperature, etc. ? so basically is the Software center capable of handling 2 A770 in one system ?

 

because if not, having both GPU's at full power cpnsumption is quite something.

 

Thank you again,

 

Cheers, T.

0 Kudos
RobbieR_Intel
Moderator
523 Views

Hello api,

 

Thank you for your response. To summarize, we conducted a replication using two Intel Arc Graphic Cards namely the A770 and A750. We observed that adjusting the GPU temperature affects only one graphics card and does not impact the other. Therefore, the GPUs are not synchronized and can be adjusted separately. We were able to save the settings without any issues.

 

Additionally, the Intel Arc Control Software can support and manage two Intel Arc Graphics Cards in one system. This also applied to other settings.

 

We look forward to your response!

 

Best Regards,

 

Robbie R.

Intel Customer Support Technician


0 Kudos
RobbieR_Intel
Moderator
438 Views

Hello api,


I hope you had the opportunity to review the information I posted. If you have further questions, kindly let us know.


Best regards,


Robbie R.

Intel Customer Support Technician


api
Novice
410 Views

Thank you very much !!

0 Kudos
RobbieR_Intel
Moderator
274 Views

Hello api,

 

Since your inquiry has been addressed, I will now close this inquiry. If you need further assistance, please feel free to create a new post. This thread will no longer be actively monitored.

Best Regards,

Robbie R.

Intel Customer Support Technician

  


0 Kudos
Reply