Intel® Distribution of OpenVINO™ Toolkit
Community support and discussions about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all things computer vision-related on Intel® platforms.

MULTI and HETERO

Wong__Jeremy
Beginner
345 Views

The Multi-Device plugin (MULTI) and the Heterogeneous plugin (HETERO) look similar. How should I choose?

0 Kudos
2 Replies
Shubha_R_Intel
Employee
345 Views

Dear Wong, Jeremy,

Good question. HETERO supports FPGA but not VPU while MULTI does not support FPGA but supports HDDL, so that is one distinguishing difference between the two. Multi-Device plugin automatically assigns inference requests to available computational devices to execute the requests in parallel.Heterogeneous plugin is more about assigning affinity (specific layers) to a preferred device with a fallback policy. HETERO's main job is to utilize accelerators power and calculate heaviest parts of network on accelerator and execute unsupported layers on fallback devices like CPU.

Hope it helps,

Thanks,

Shubha

 

 

Kenneth_C_Intel
Employee
345 Views

I would look at the information of the pages 

https://docs.openvinotoolkit.org/latest/_docs_IE_DG_supported_plugins_HETERO.html

and 

https://docs.openvinotoolkit.org/latest/_docs_IE_DG_supported_plugins_MULTI.html

Honestly it depends on what you are trying to accomplish and how. 

 

Reply