can we finetune llama3.1 70b on the free tier

[gauravvk]

want to check if we can fine llama3.1 70b on 

Intel(R) Data Center GPU Max 1100 * 8

[Athirah_Intel]

Hi gauravvk,

Thank you for reaching out to us.

We have informed the relevant team regarding this issue. We will get back to you once we receive any feedback from them. Thank you for your patience.

Regards,

Athirah

[Athirah_Intel · Accepted solution]

Hi gauravvk,

We just got an update from the relevant team regarding this issue.

For your information, there is currently no experiment on llama3.1 7b. However, we do have an article that tests the llama2 model on Intel Data Center GPUs.

Fine-tuning Llama 2 models on Intel® Data Center GPUs using BigDL LLM

Additionally, currently, Intel(R) Data Center GPU Max 1100 is not shown in the free and premium. Customers have to request whitelisted (with justification) to see the available option.

Regards,

Athirah

[Athirah_Intel]

Hi gauravvk,

This thread will no longer be monitored since we have provided a solution. If you need any additional information from Intel, please submit a new question. 

Regards,

Athirah