Community
cancel
Showing results for 
Search instead for 
Did you mean: 
Deprost__Emiel
Beginner
46 Views

Long execution time of non linearities

Hello,

I was doing some performance tests on mobilenet with the Movidius stick.  I used the pretrainded mobilenet-v1-1.0-224 downloaded with the open model zoo downloader.  I made a pie chart of the inference time for every specific layer type, this is the result:

What I don't understand is why the non-linearities (Bias & Relu) are taking 27% of the inference time. How is it possible that those non-linearities are taking so much time?

Thanks in advance,

Emiel Deprost

0 Kudos
1 Reply
Yuanyuan_L_Intel
Employee
46 Views

The MAC(memory access cost)  of those elem-wise operations like bias/relu can't be ignored in small networks. There are some studies in shufflenetv2 paper https://arxiv.org/abs/1807.11164