Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.

GPT-OSS OpenVINO questions

Echo9Zulu
Beginner
444 Views

Hello everyone,

 

From keeping up with development in Optimum-Intel and OpenVINO GenAI I know that gpt-oss architecture is supported in OpenVINO and that performance is expected to improve by 2025.4. I am SearchSavior.

 

However, obtaining OpenVINO IR and inferencing returns only "!!!!!!!" until max_new_tokens. See this issue from mwrothbe. We have been tinkering with gpt-oss-20b on and off for a few weeks, especially after this PR was merged into OpenVINO GenAI without progress. Yet while development continues we have no idea where to follow. 

 

Maybe the documentation should be updated if gpt-oss support is still baking?

 

Thank you,

Emerson

0 Kudos
3 Replies
Zulkifli_Intel
Moderator
345 Views

Hi Echo9Zulu,

 Thank you for reaching out.

 

Since this is the same issue as the one on GitHub #2984, we will continue the investigation there and close this thread. Are you okay with this arrangement?

 

 

Regards,

Zul


0 Kudos
Echo9Zulu
Beginner
248 Views

Hello Zul,

 

Sure, that sounds good. Look forward to collaborating on this issue.

 

Emerson.

0 Kudos
Zulkifli_Intel
Moderator
119 Views

Thank you for your question. If you need any additional information from Intel, please submit a new question, as this thread is no longer being monitored. 


0 Kudos
Reply