Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.

[Dynamic batch size] Model Resnet50 set dynamic batch size failed!

ke__xu
初心者
1,750件の閲覧回数

Hello Sir,

 My Env: Win10, Intel CPU i7(8750H), SDK 2019 R2

 It it run OK for fixed batch size = 2;

 But When it is set to be dynamic batch size, It print failed at run:

   "executable_network = core.LoadNetwork(network, dyn_config);"

 Error log:

   "MKLDNNGraph::CreateGraph: such topology cannot be complied for dynamic batch! Error"

 My Question: Is it not support dynamic batch for Resnet50 model ?

Best Regards,

Ke

 

0 件の賞賛
1 解決策
Shubha_R_Intel
従業員
1,750件の閲覧回数

Dear ke, xu,

As the Dynamic Batching Doc says, Dynamic Batching supports only some layers.  My guess is that Resnet50 has some unsupported layers.

Hope it helps,

Thanks,

Shubha

元の投稿で解決策を見る

5 返答(返信)
ke__xu
初心者
1,750件の閲覧回数

More info:

Log is same with "Dynamic Batching with Face Detection Model"

https://software.intel.com/en-us/forums/computer-vision/topic/808634

 

Shubha_R_Intel
従業員
1,751件の閲覧回数

Dear ke, xu,

As the Dynamic Batching Doc says, Dynamic Batching supports only some layers.  My guess is that Resnet50 has some unsupported layers.

Hope it helps,

Thanks,

Shubha

ke__xu
初心者
1,750件の閲覧回数

Dear Shubha,

 Thank you very much!

Shubha_R_Intel
従業員
1,750件の閲覧回数

Dear Dear ke, xu,

Of course ! 

Glad to help.

Thanks,

Shubha

Prof_Joshua_Smith
ビギナー
1,742件の閲覧回数

@Shubha_R_Intel Hi,

I couldn't any models supporting dynamic batch sizing, even the example scenario given in the docs doesn't seem working. Is there any possible way we can solve this issue?? It'd great if you could write back.

返信