Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.

Optimizing Dolly 2

Berdy
New Contributor I
672 Views

I attended today's (6/28/2023) OpenVino 2023.00 workshop. It was indicated that there is a sample code implementation using the Dolly-2 LLM implementation at github's openvino_notebboks.

While there is a link to it, there is actually no code available there. There is only an explanation of what Dooly is about. Could anyone provide any sample code for optimizing/quantizing NLP models, being Dolly, T5, or any other autoregressive model?

Thanks,

Berdy

0 Kudos
1 Solution
Aznie_Intel
Moderator
654 Views

 

Hi Berdy,

 

Thanks for reaching out.

 

You may refer the tutorial for using Databricks Dolly 2.0 and OpenVINO from OpenVINO notebooks documentation or 240-dolly-2-instruction-following.ipynb.

 

 

Regards,

Aznie

 

 

View solution in original post

0 Kudos
3 Replies
Aznie_Intel
Moderator
655 Views

 

Hi Berdy,

 

Thanks for reaching out.

 

You may refer the tutorial for using Databricks Dolly 2.0 and OpenVINO from OpenVINO notebooks documentation or 240-dolly-2-instruction-following.ipynb.

 

 

Regards,

Aznie

 

 

0 Kudos
Berdy
New Contributor I
641 Views

Aznie, thanks very much for the links.

0 Kudos
Aznie_Intel
Moderator
620 Views

Hi Berdy,


This thread will no longer be monitored since we have provided the information. If you need any additional information from Intel, please submit a new question. 



Regards,

Aznie


0 Kudos
Reply