Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.
6403 Discussions

Does OpenVINO support NLP, like BERT model?

lin__xiaobo
Beginner
493 Views

I use mo.py to convert BERT model, but error occur.

I use tf.train.Example().SerializeToString() as input Node, I think the error is about this, but I can not fix it.

0 Kudos
1 Reply
Shubha_R_Intel
Employee
493 Views

Dear lin, xiaobo,

OpenVino is primarily a Computer Vision (CNN) tool. However some aspects of RNN such as LSTM and GRU (used by NLP applications) are definitely supported.

BERT apparently uses the Transformer which is LSTM-based Encoder/Decoder topology which avoids RNN. I will tell you that BERT is not one of OpenVino's tested and validated models. 

The train.* error you are getting though makes me think that you are not freezing the BERT Tensorflow model before feeding it to OpenVino Model Optimizer. If the model is properly frozen, then you will not see errors related to training. Please review Freezing Tensorflow Models for more information about freezing a Tensorflow model.

Hope it helps,

Thanks,

Shubha

0 Kudos
Reply