Intel® Distribution of OpenVINO™ Toolkit
Community support and discussions about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all things computer vision-related on Intel® platforms.
6017 Discussions

Is it possible to support the Nnet3 Model fully and provide a simple inference pipeline like the Nne

Roxy1
Beginner
422 Views

According to our understanding, it is not intuitive to use Model Optimizer (mo_kaldi.py) to convert Kaldi Nnet3 Model input and provide it(Kaldi Nnet3 Model) to the application demo (Live Speech Recognition Demo). In addition to using iVector as a common feature input, nnet3 also uses the following Layers, but I know that support of the nnet3 format is limited.Layers (BatchNorm, Dropout, GeneralDropout, NoOp, SpecAugmentTimeMask, FixedAffine, Linear, LogSoftmax, NaturalGradientAffine, RectifiedLinear, Tdnn)

( Reference:
https://docs.openvinotoolkit.org/2021.4/openvino_docs_MO_DG_prepare_model_convert_model_kaldi_specif...
https://docs.openvino.ai/2021.4/openvino_docs_MO_DG_prepare_model_Supported_Frameworks_Layers.html#d...)

The common and latest technology of the Kaldi toolkit is developed on Nnet3 architecture, and the training of Nnet1 architecture is quite time-consuming and the training effect is not as good as the Nnet3 model. If the Kaldi Nnet3 architecture could have more comprehensive support in the future, it will be able to provide the R & D team with a more friendly development environment. Also, it will be easier to popularize and apply on the edge application because the traditional speech recognization model (Kaldi Model) is more stable than the E2E Model.

0 Kudos
4 Replies
IntelSupport
Community Manager
382 Views

Hi Roxy1,

Thanks for reaching out to us.

 

We are checking on this with our development team and update you with the information soon.

 

Meanwhile, for the iVector feature input, you might want to try implementing the

Convert ASpIRE Chain TDNN Model to IR method and see if this can work on your model.

 

Regards,

Aznie


Roxy1
Beginner
345 Views

Update subject as follow.

Is it possible to support the Nnet3 Model fully and provide a simple inference pipeline like the Nnet1 model on the online demo in the future since Nnet1 is a long time ago architecture?

IntelSupport
Community Manager
334 Views

Hi Roxy1,

As from our developer feedback, currently, Nnet3 is not supported and there is no plan or roadmap for the model to be supported yet.

 

Regards,

Aznie


IntelSupport
Community Manager
299 Views

Hi Roxy1,

This thread will no longer be monitored since we have provided the information. If you need any additional information from Intel, please submit a new question.


Regards,

Aznie



Reply