Community
cancel
Showing results for 
Search instead for 
Did you mean: 
Wong__Jeremy
Beginner
207 Views

MULTI and HETERO

The Multi-Device plugin (MULTI) and the Heterogeneous plugin (HETERO) look similar. How should I choose?

0 Kudos
2 Replies
Shubha_R_Intel
Employee
207 Views

Dear Wong, Jeremy,

Good question. HETERO supports FPGA but not VPU while MULTI does not support FPGA but supports HDDL, so that is one distinguishing difference between the two. Multi-Device plugin automatically assigns inference requests to available computational devices to execute the requests in parallel.Heterogeneous plugin is more about assigning affinity (specific layers) to a preferred device with a fallback policy. HETERO's main job is to utilize accelerators power and calculate heaviest parts of network on accelerator and execute unsupported layers on fallback devices like CPU.

Hope it helps,

Thanks,

Shubha

 

 

Kenneth_C_Intel
Employee
207 Views

I would look at the information of the pages 

https://docs.openvinotoolkit.org/latest/_docs_IE_DG_supported_plugins_HETERO.html

and 

https://docs.openvinotoolkit.org/latest/_docs_IE_DG_supported_plugins_MULTI.html

Honestly it depends on what you are trying to accomplish and how. 

 

Reply