Long execution time of non linearities

[Deprost__Emiel]

Hello,

I was doing some performance tests on mobilenet with the Movidius stick.  I used the pretrainded mobilenet-v1-1.0-224 downloaded with the open model zoo downloader.  I made a pie chart of the inference time for every specific layer type, this is the result:

What I don't understand is why the non-linearities (Bias & Relu) are taking 27% of the inference time. How is it possible that those non-linearities are taking so much time?

Thanks in advance,

Emiel Deprost

[Yuanyuan_L_Intel]

The MAC(memory access cost)  of those elem-wise operations like bias/relu can't be ignored in small networks. There are some studies in shufflenetv2 paper https://arxiv.org/abs/1807.11164