Intel® Developer Cloud
Help connecting to or getting started on Intel® Developer Cloud
201 Discussions

can we finetune llama3.1 70b on the free tier

gauravvk
Beginner
183 Views

want to check if we can fine llama3.1 70b on 

Intel(R) Data Center GPU Max 1100 * 8
Labels (1)
0 Kudos
2 Replies
Athirah_Intel
Moderator
136 Views

Hi gauravvk,

Thank you for reaching out to us.

 

We have informed the relevant team regarding this issue. We will get back to you once we receive any feedback from them. Thank you for your patience.

 

 

Regards,

Athirah


0 Kudos
Athirah_Intel
Moderator
105 Views

Hi gauravvk,

We just got an update from the relevant team regarding this issue.

 

For your information, there is currently no experiment on llama3.1 7b. However, we do have an article that tests the llama2 model on Intel Data Center GPUs.

Fine-tuning Llama 2 models on Intel® Data Center GPUs using BigDL LLM

 

Additionally, currently, Intel(R) Data Center GPU Max 1100 is not shown in the free and premium. Customers have to request whitelisted (with justification) to see the available option.

 

 

Regards,

Athirah


0 Kudos
Reply