WPOD Network Speedup Issue with OpenVINO 2023.0

[Tetali-875]

Hello OpenVINO Community,

I am currently working on optimizing the performance of a WPOD network using OpenVINO 2023.0, and I am encountering challenges in achieving the desired speedup. Interestingly, when I applied similar optimization techniques to a ResNet model, I achieved a 1.8x speedup. However, with the WPOD network, I'm observing a decrease in speed. I appreciate any guidance or insights the community can provide.

Below i had provided the xml files as bin files arent supported while the size of bin file was reduced by 4 times for int8.

Your assistance is highly appreciated. Thank you!

[Zulkifli_Intel]

Hi Tetali-875

Thank you for reaching out to us.

Please share with us the following details for replication purposes:

• Model optimization steps and commands
• Original model
• Converted model (FP32 and INT8)
• Reference codes
• Hardware (CPU/GPU)

You can place the necessary files in Google Drive and share the link here (or to my email zulkiflix.bin.abdul.halim@intel.com).

Regards,

Zulkifli

[Zulkifli_Intel]

Hi, thank you for your question. If you need any additional information from Intel, please submit a new question as this thread is no longer being monitored.