Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.
6493 Discussions

Having different calculation result between cpu and npu with nan, inf op.

WilsonChen0723
Beginner
924 Views

Hi.

 

This is the same question to 

link

Because the old one maybe out of track because my late reply, sorry.

All the files can be download from the last post.

 

I'm having different results for the same calculation with different processing units.

And it will result in precision error in the final.

 

CPU : Intel® Core™ Ultra 5 processor 135H

OS : Windows 11 enterprise.

■ 2023.2
-- out_0132__model_dep_encoder_Resize_NPU.npy
(0,1, 8, 0)    [          nan,       -273.75,      0.206299,       0.40625,
(0,1,11, 0)    [          inf,           nan,      0.136963,      0.171631,
-- out_0132__model_dep_encoder_Resize_CPU.npy
(0,1, 8, 0)    [     0.313762,      0.260029,      0.206297,      0.406028,
(0,1,11, 0)    [     0.005915,     0.0714487,      0.136982,      0.171628,

■ 2023.1
-- out_0132__model_dep_encoder_Resize_NPU.npy
(0,1, 8, 0)    [          nan,           inf,      0.206299,       0.40625,
(0,1,11, 0)    [         -inf,           nan,      0.136963,      0.171631,
-- out_0132__model_dep_encoder_Resize_CPU.npy
(0,1, 8, 0)    [     0.313762,      0.260029,      0.206297,      0.406028,
(0,1,11, 0)    [     0.005915,     0.0714487,      0.136982,      0.171628,

 

 

0 Kudos
3 Replies
Hairul_Intel
Moderator
888 Views

Hi WilsonChen0723,

Thank you for sharing all the information.

 

We're investigating this issue and will update you on any findings as soon as possible.

 

 

Regards,

Hairul


0 Kudos
Megat_Intel
Moderator
643 Views

Hi WilsonChen0723,

Thank you for your patience and we apologize for the delay

 

For your information, there is a new update to the NPU driver version 32.0.100.2267 for Windows and a new OpenVINO™ version 2024.

 

On our end, we updated the NPU driver to the latest version and were able to build and run the custom benchmark_app C++ script in OpenVINO™ 2023.2. However, we are still observing the issue. On another note, we were unable to build the custom benchmark_app C++ script for the new OpenVINO™ 2024 version.

 

Could you please update the NPU driver to version 32.0.100.2267 and modify the benchmark_app C++ script to work with the new and improved OpenVINO™ 2024 version and see if you are still observing the issue? Hope this helps.

 

 

Regards,

Megat


0 Kudos
Megat_Intel
Moderator
513 Views

Hi WilsonChen0723,

Thank you for your question. This thread will no longer be monitored since we have provided a suggestion. If you need any additional information from Intel, please submit a new question.

 

 

Regards,

Megat


0 Kudos
Reply