- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi,
I use OpenVino to infer a ResNet50 model. When I start only one process, inference time is about 300ms.
But When I start another process(just make a copy), both processes inference time become 600ms.
Inference time of different processes affect each other? Could you give me some information about it?
Thanks a lot!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Aznie,
Thanks a lot for your reply.
I fixed the issue by SetConfig({ { CONFIG_KEY(CPU_BIND_THREAD), "NO" } }, "CPU"). It seems that CPU_BIND_THREAD default config is "YES". It works well on Windows but on Linux the two processes seem to bind same cpu core and inference time turns dobule. After I set it to NO in the code, both Windows and Linux work well.
Regards,
Link Copied
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Lei yan,
Could you provide me the details on what program you are running? Which sample or demo of OpenVINO Toolkit you are rusing? Also, please provide me the environment of your machine and the version of OpenVINO Toolkit.
Regards,
Aznie
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Aznie,
Thanks a lot for your reply.
I fixed the issue by SetConfig({ { CONFIG_KEY(CPU_BIND_THREAD), "NO" } }, "CPU"). It seems that CPU_BIND_THREAD default config is "YES". It works well on Windows but on Linux the two processes seem to bind same cpu core and inference time turns dobule. After I set it to NO in the code, both Windows and Linux work well.
Regards,
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Lei Yan,
Thank you for sharing the solution. For more information, you also can test the program on the benchmark app and have a look at the parameter of the benchmark app to compare the inference time. This thread will no longer be monitored since this issue has been resolved. If you need any additional information from Intel, please submit a new question.
Regards,
Aznie
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
For OpenVINO 2.0, if you want to disable the thread binding you can use these.
ov::Core core;
core.set_property("CPU", ov::affinity(ov::Affinity::NONE));
Full information can be found here. I hope it is useful.
![](/skins/images/D3C0B914909A6564BBB97F4AD1ED1973/responsive_peak/images/icon_anonymous_message.png)
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page