Community
cancel
Showing results for 
Search instead for 
Did you mean: 
lin__xiaobo
Beginner
205 Views

Does OpenVINO support NLP, like BERT model?

I use mo.py to convert BERT model, but error occur.

I use tf.train.Example().SerializeToString() as input Node, I think the error is about this, but I can not fix it.

0 Kudos
1 Reply
Shubha_R_Intel
Employee
205 Views

Dear lin, xiaobo,

OpenVino is primarily a Computer Vision (CNN) tool. However some aspects of RNN such as LSTM and GRU (used by NLP applications) are definitely supported.

BERT apparently uses the Transformer which is LSTM-based Encoder/Decoder topology which avoids RNN. I will tell you that BERT is not one of OpenVino's tested and validated models. 

The train.* error you are getting though makes me think that you are not freezing the BERT Tensorflow model before feeding it to OpenVino Model Optimizer. If the model is properly frozen, then you will not see errors related to training. Please review Freezing Tensorflow Models for more information about freezing a Tensorflow model.

Hope it helps,

Thanks,

Shubha

Reply