Openvino2023.0 will report error if using dynamic shape

[huany11]

(openvino_env) PS T:\openvino\openvino_env\Scripts> .\benchmark_app.exe -m T:\openvino\models\angio_segmentation_48.onnx -shape [345,48,48,1] -d GPU -niter 8
[Step 1/11] Parsing and validating input arguments
[ INFO ] Parsing input parameters
[Step 2/11] Loading OpenVINO Runtime
[ INFO ] OpenVINO:
[ INFO ] Build ................................. 2023.0.1-11005-fa1c41994f3-releases/2023/0
[ INFO ]
[ INFO ] Device info:
[ INFO ] GPU
[ INFO ] Build ................................. 2023.0.1-11005-fa1c41994f3-releases/2023/0
[ INFO ]
[ INFO ]
[Step 3/11] Setting device configuration
[ WARNING ] Performance hint was not explicitly specified in command line. Device(GPU) performance hint will be set to PerformanceMode.THROUGHPUT.
[Step 4/11] Reading model files
[ INFO ] Loading model files
[ INFO ] Read model took 60.83 ms
[ INFO ] Original model I/O parameters:
[ INFO ] Model inputs:
[ INFO ] x (node: x) : f32 / [...] / [?,48,48,1]
[ INFO ] Model outputs:
[ INFO ] activation_40 (node: activation_40) : f32 / [...] / [?,2304,2]
[Step 5/11] Resizing model to match image sizes and given batch
[ INFO ] Model batch size: 345
[ INFO ] Reshaping model: 'x': [345,48,48,1]
[ INFO ] Reshape model took 29.90 ms
[Step 6/11] Configuring input of the model
[ INFO ] Model inputs:
[ INFO ] x (node: x) : f32 / [N,H,W,C] / [345,48,48,1]
[ INFO ] Model outputs:
[ INFO ] activation_40 (node: activation_40) : f32 / [...] / [345,2304,2]
[Step 7/11] Loading the model to the device
[ ERROR ] Check 'false' failed at C:\Jenkins\workspace\private-ci\ie\build-windows-vs2019@3\b\repos\openvino\src\inference\src\core.cpp:117:
Check 'std::numeric_limits<StorageDataType>::max() >= value' failed at C:\Jenkins\workspace\private-ci\ie\build-windows-vs2019@3\b\repos\openvino\src\core\include\openvino/op/constant.hpp:521

Traceback (most recent call last):
File "T:\openvino\openvino_env\lib\site-packages\openvino\tools\benchmark\main.py", line 408, in main
compiled_model = benchmark.core.compile_model(model, benchmark.device, device_config)
File "T:\openvino\openvino_env\lib\site-packages\openvino\runtime\ie_api.py", line 398, in compile_model
super().compile_model(model, device_name, {} if config is None else config),
RuntimeError: Check 'false' failed at C:\Jenkins\workspace\private-ci\ie\build-windows-vs2019@3\b\repos\openvino\src\inference\src\core.cpp:117:
Check 'std::numeric_limits<StorageDataType>::max() >= value' failed at C:\Jenkins\workspace\private-ci\ie\build-windows-vs2019@3\b\repos\openvino\src\core\include\openvino/op/constant.hpp:521

[Wan_Intel]

Hello Huany11,

Thanks for reaching out to us.

Is your model Natural Language Processing model? Dynamic shapes are now supported for GPU inference for Natural Language Processing models. More models will be supported in future OpenVINO releases. You may refer to the link below for more information:

https://www.intel.com/content/www/us/en/developer/articles/release-notes/openvino/2023-0.html

Please share your model with us if it is Natural Language Processing model.

Regards,

Wan

[Wan_Intel]

Hello Huany11,

If you need any additional information from Intel, please submit a new question as this thread will no longer be monitored.

Regards,

Wan