Having different calculation result between cpu and npu with nan, inf op.

[WilsonChen0723]

Hi.

This is the same question to 

link

Because the old one maybe out of track because my late reply, sorry.

All the files can be download from the last post.

I'm having different results for the same calculation with different processing units.

And it will result in precision error in the final.

CPU : Intel® Core™ Ultra 5 processor 135H

OS : Windows 11 enterprise.

■ 2023.2
-- out_0132__model_dep_encoder_Resize_NPU.npy
(0,1, 8, 0)    [          nan,       -273.75,      0.206299,       0.40625,
(0,1,11, 0)    [          inf,           nan,      0.136963,      0.171631,
-- out_0132__model_dep_encoder_Resize_CPU.npy
(0,1, 8, 0)    [     0.313762,      0.260029,      0.206297,      0.406028,
(0,1,11, 0)    [     0.005915,     0.0714487,      0.136982,      0.171628,

■ 2023.1
-- out_0132__model_dep_encoder_Resize_NPU.npy
(0,1, 8, 0)    [          nan,           inf,      0.206299,       0.40625,
(0,1,11, 0)    [         -inf,           nan,      0.136963,      0.171631,
-- out_0132__model_dep_encoder_Resize_CPU.npy
(0,1, 8, 0)    [     0.313762,      0.260029,      0.206297,      0.406028,
(0,1,11, 0)    [     0.005915,     0.0714487,      0.136982,      0.171628,

[Hairul_Intel]

Hi WilsonChen0723,

Thank you for sharing all the information.

We're investigating this issue and will update you on any findings as soon as possible.

Regards,

Hairul

[Megat_Intel]

Hi WilsonChen0723,

Thank you for your patience and we apologize for the delay

For your information, there is a new update to the NPU driver version 32.0.100.2267 for Windows and a new OpenVINO™ version 2024.

On our end, we updated the NPU driver to the latest version and were able to build and run the custom benchmark_app C++ script in OpenVINO™ 2023.2. However, we are still observing the issue. On another note, we were unable to build the custom benchmark_app C++ script for the new OpenVINO™ 2024 version.

Could you please update the NPU driver to version 32.0.100.2267 and modify the benchmark_app C++ script to work with the new and improved OpenVINO™ 2024 version and see if you are still observing the issue? Hope this helps.

Regards,

Megat

[Megat_Intel]

Hi WilsonChen0723,

Thank you for your question. This thread will no longer be monitored since we have provided a suggestion. If you need any additional information from Intel, please submit a new question.

Regards,

Megat