use 2 intel GPU's in one pc to allow bigger LLM models

[api]

Hi there, i have actually a few questions ...

I found out that intel does not support something similar to SLI or xfire .... and the Deep Link function does only support integrated + external GPU ... still true ?

If i Install 2 lets say A770 with 16 GB each, can it be used as a 32 GB unit for LLM's ? in Vulcan or so ? maybe even if the second GPU only is used for its Vram ?

Can the intel Driver Software on Windows confugure both GPU's ? in terms of reducing the Power consumption, or change the max GPU temperature, etc. ? so basically is the Software center capable of handling 2 A770 in one system ?

Thank you very much in advance!!

Cheers, T.

[Stefan3D]

SLI and Crossfire are meanwhile out-dated technologies for graphics rendering, not necessary for computing.

Vulkan compute exists theoretically, but nobody uses it.

In general get familiar with OpenCL - https://www.khronos.org/opencl/

[api]

Sorry but you did not answer any of the questions from above, just providing your opinion

Thank you for the link to OpenCL, but i hope someone will actually read what i wrote and help me with that
Cheers, T.

[RobbieR_Intel]

Hello api,

Thank you for reaching out! We would like to inform you we are currently investigating your inquiry and need more time to further check the details.

Best Regards,

Robbie R.

Intel Customer Support Technician

[RobbieR_Intel]

Hello api,

Thank you for reaching out! Deep link technology currently supports pairing integrated GPU with a discrete GPU. This is a combination of Intel Arc discrete GPU with Intel Iris Xe integrated graphics found in 12th-generation processors or newer. For more information regarding this, please see Does Intel® Arc™ Support Multi-GPU? and Can Two Intel® Arc™ Graphics Cards be Installed and Operated as One Unit?

For your question, using 2 Arc GPUs for LLM interfacing is supported using IPEX-LLM. For more information about IPEX-LLM, please see Run IPEX-LLM serving on Multiple Intel GPUs using DeepSpeed AutoTP and FastApi — IPEX-LLM latest documentation.

We look forward to your response!

Best regards,

Robbie R.

Intel Customer Support Technician

[api]

very much for your answers, just one major question is still open 

Can the intel Driver Software on Windows confugure both GPU's ? in terms of reducing the Power consumption, or change the max GPU temperature, etc. ? so basically is the Software center capable of handling 2 A770 in one system ?

because if not, having both GPU's at full power cpnsumption is quite something.

Thank you again,

Cheers, T.

[RobbieR_Intel]

Hello api,

Thank you for your response. To summarize, we conducted a replication using two Intel Arc Graphic Cards namely the A770 and A750. We observed that adjusting the GPU temperature affects only one graphics card and does not impact the other. Therefore, the GPUs are not synchronized and can be adjusted separately. We were able to save the settings without any issues.

Additionally, the Intel Arc Control Software can support and manage two Intel Arc Graphics Cards in one system. This also applied to other settings.

We look forward to your response!

Best Regards,

Robbie R.

Intel Customer Support Technician

[RobbieR_Intel · Accepted solution]

Hello api,

I hope you had the opportunity to review the information I posted. If you have further questions, kindly let us know.

Best regards,

Robbie R.

Intel Customer Support Technician

[api]

Thank you very much !!

[RobbieR_Intel]

Hello api,

Since your inquiry has been addressed, I will now close this inquiry. If you need further assistance, please feel free to create a new post. This thread will no longer be actively monitored.

Best Regards,

Robbie R.

Intel Customer Support Technician