Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.
6403 Discussions

Is it possible to support the Nnet3 Model fully and provide a simple inference pipeline like the Nne

Roxy1
Novice
837 Views

According to our understanding, it is not intuitive to use Model Optimizer (mo_kaldi.py) to convert Kaldi Nnet3 Model input and provide it(Kaldi Nnet3 Model) to the application demo (Live Speech Recognition Demo). In addition to using iVector as a common feature input, nnet3 also uses the following Layers, but I know that support of the nnet3 format is limited.Layers (BatchNorm, Dropout, GeneralDropout, NoOp, SpecAugmentTimeMask, FixedAffine, Linear, LogSoftmax, NaturalGradientAffine, RectifiedLinear, Tdnn)

( Reference:
https://docs.openvinotoolkit.org/2021.4/openvino_docs_MO_DG_prepare_model_convert_model_kaldi_specific_Aspire_Tdnn_Model.html
https://docs.openvino.ai/2021.4/openvino_docs_MO_DG_prepare_model_Supported_Frameworks_Layers.html#doxid-openvino-docs-m-o-d-g-prepare-model-supported-frameworks-layers)

The common and latest technology of the Kaldi toolkit is developed on Nnet3 architecture, and the training of Nnet1 architecture is quite time-consuming and the training effect is not as good as the Nnet3 model. If the Kaldi Nnet3 architecture could have more comprehensive support in the future, it will be able to provide the R & D team with a more friendly development environment. Also, it will be easier to popularize and apply on the edge application because the traditional speech recognization model (Kaldi Model) is more stable than the E2E Model.

0 Kudos
4 Replies
IntelSupport
Moderator
797 Views

Hi Roxy1,

Thanks for reaching out to us.

 

We are checking on this with our development team and update you with the information soon.

 

Meanwhile, for the iVector feature input, you might want to try implementing the

Convert ASpIRE Chain TDNN Model to IR method and see if this can work on your model.

 

Regards,

Aznie


0 Kudos
Roxy1
Novice
760 Views

Update subject as follow.

Is it possible to support the Nnet3 Model fully and provide a simple inference pipeline like the Nnet1 model on the online demo in the future since Nnet1 is a long time ago architecture?

0 Kudos
IntelSupport
Moderator
749 Views

Hi Roxy1,

As from our developer feedback, currently, Nnet3 is not supported and there is no plan or roadmap for the model to be supported yet.

 

Regards,

Aznie


0 Kudos
IntelSupport
Moderator
714 Views

Hi Roxy1,

This thread will no longer be monitored since we have provided the information. If you need any additional information from Intel, please submit a new question.


Regards,

Aznie



0 Kudos
Reply