In the Myriad X VPU product brief, "Myriad X VPU is capable of delivering a total performance of over 4 trillion operations per second (TOPS)"
in another page, it also says "Over 1 trillion operations per second of DNN inferencing performance".
I also tested OpenVINO pre-trained models, and have below performance result.
face-detection-retail-0004 (Complexity 1.067 GFLOPs) takes 20ms for one image. 1.067/0.02=53 => 53 GFLOPs
human-pose-estimation-0001 (Complexity 15.435 GFLOPs) takes 200 ms for one image. 15.535/0.2=78 => 78 GFLOPs
Why the product brief says the performance is 4TOPS and 1TOPS. But the result of real tests is no more than 100 GFLOPs.
And could you teach me the correct evaluation method of the performance (FLOPS)?
All in all Bruce, if you improve your measurement accuracy, you should get 2-2.5 times higher numbers. I agree that some of the Myriad-X VPU documentation assumes a lot and does not give you the detail which I have just given you.
Thanks for using OpenVino !