Solved: Processing time not consistent on openVino async mode with ncs2

Lee__Terry · ‎02-06-2019

When I run the example "object_detection_demo_ssd_async"

For Sync mode, the processing time is consistent at around 80 ms.

For Async mode, the processing time is not consistent. frame 0 = 12ms, frame 1 = 130, frame 2 = 12, frame 3 = 120 ......

I have try removing display and I/O. The problem persist.

Is this this normal ? Any logical explanation ?

The average time on Async mode (70ms) is smaller than the Sync mdoe (80 ms).

Any thoughts on the issue would be greatly appreciated.

Environment: OpenVino R5,windows 10, video, ncs2, ssd_mobilenet_v2_coco, object_detection_demo_ssd_async, release mode.

Thanks,
Terry

nikos1 · ‎02-07-2019

Hello Terry,

I get the same issue as yours. Async can be tricky, you can study the source code to see how this is calculated. Displayed times are just an indication, please feel free to ignore them if you wish. if you really want to see exact measurements you need to use a profiler. A good alternative is to try to use object_detection_demo_ssd_async with the -pc parameter (not in async mode) let it run for a while and the press Esc to exit. Divide 1000000 by the Total time: X microseconds that is displayed at the terminal. I believe this is a good indication of the maximum fps you can achieve if you feed the inference device fast enough. This number does not vary a lot, does it? Maybe other experts in this forum have more suggestion. I personally use profilers and study detailed timelines.

Cheers,

nikos

View solution in original post

nikos1 · ‎02-07-2019

Hello Terry,

I get the same issue as yours. Async can be tricky, you can study the source code to see how this is calculated. Displayed times are just an indication, please feel free to ignore them if you wish. if you really want to see exact measurements you need to use a profiler. A good alternative is to try to use object_detection_demo_ssd_async with the -pc parameter (not in async mode) let it run for a while and the press Esc to exit. Divide 1000000 by the Total time: X microseconds that is displayed at the terminal. I believe this is a good indication of the maximum fps you can achieve if you feed the inference device fast enough. This number does not vary a lot, does it? Maybe other experts in this forum have more suggestion. I personally use profilers and study detailed timelines.

Cheers,

nikos

Lee__Terry · ‎02-07-2019

Hi Nikos,

Thanks for the quick respond and the detail explanation.

I'm still not sure if I got it right. Is 70ms average processing time for ssd_mobilenet_v2_coco model on tensorflow with NCS2 sound reasonable for resolution of 300x300?

Terry

nikos1 · ‎02-07-2019

Hi Terry,

> Is 70ms average processing time for ssd_mobilenet_v2_coco model on tensorflow with NCS2 sound reasonable for resolution of 300x300?

Not right, that's a bit slow. I am not on Windows (will test later, but Ubuntu NC2 300x300 MB-net-SSD takes less than 35ms for me here.

Could you please run with -pc and post complete output here? Also include API / build versions, mine are

InferenceEngine: 
	API version ............ 1.4
	Build .................. 19154
[ INFO ] Parsing input parameters
[ INFO ] Reading input
[ INFO ] Loading plugin

	API version ............ 1.5
	Build .................. 19154
	Description ....... myriadPlugin

Cheers,

nikos

Lee__Terry · ‎02-08-2019

Hi Nikos,

While the clock time in on image shows 30ms on image most of the time. The average is 87. I added display for total time/count.

Could you verify that the time you see is average? not the time show on the image display.

Thanks,

Terry

InferenceEngine:
API version ............ 1.4
Build .................. 19154
[ INFO ] Parsing input parameters
[ INFO ] Reading input
[ INFO ] Loading plugin

API version ............ 1.5
Build .................. 19154
Description ....... myriadPlugin
[ INFO ] Loading network files
[ INFO ] Batch size is forced to 1.
[ INFO ] Checking that the inputs are as the demo expects
[ INFO ] Checking that the outputs are as the demo expects
[ INFO ] Loading model to the plugin
[ INFO ] Start inference[ INFO ] Average time: 87.3761
[ INFO ] Average time: 87.5408
[ INFO ] Average time: 87.5741
[ INFO ] Average time: 87.7045
[ INFO ] Average time: 87.4694
[ INFO ] Average time: 87.6464
[ INFO ] Average time: 87.4429

nikos1 · ‎02-08-2019

Hi Terry,

In this case looks normal.

BTW could you post your output after using -pc parameter just to make sure?

nikos

Lee__Terry · ‎02-08-2019

Hi Nikos,

Is -pc parameter mean using -d CPU instead of myriad ?

if so, the average time is 27ms. with i7 4 cores computer.

NCS2 is much slower than CUP. What am I missing ?

InferenceEngine:
API version ............ 1.4
Build .................. 19154
[ INFO ] Parsing input parameters
[ INFO ] Reading input
[ INFO ] Loading plugin

API version ............ 1.5
Build .................. win_20181005
Description ....... MKLDNNPlugin
[ INFO ] Loading network files
[ INFO ] Batch size is forced to 1.
[ INFO ] Checking that the inputs are as the demo expects
[ INFO ] Checking that the outputs are as the demo expects
[ INFO ] Loading model to the plugin
[ INFO ] Start inference

nikos1 · ‎02-08-2019

> Is -pc parameter mean using -d CPU instead of myriad ?

Still using MYRIAD with -pc but report the performance counters per layer.

Could you attach the complete command and also output please?

Still using -d MYRIAD but add -pc like for example

object_detection_demo_ssd_async -i some_test_clip.mp4  -m your_ssd.xml -D MYRIAD -pc

Lee__Terry · ‎02-08-2019

I did not know about the -pc option. Thanks.

-i c:\t\s2\t1.avi -m C:\t\y11\IR\frozen_inference_graph.xml -d MYRIAD -pc -t 0.5

on project: object_detection_demo_ssd_async

Report

InferenceEngine:
API version ............ 1.4
Build .................. 19154
[ INFO ] Parsing input parameters
[ INFO ] Reading input
[ INFO ] Loading plugin

API version ............ 1.5
Build .................. 19154
Description ....... myriadPlugin
[ INFO ] Loading network files
[ INFO ] Batch size is forced to 1.
[ INFO ] Checking that the inputs are as the demo expects
[ INFO ] Checking that the outputs are as the demo expects
[ INFO ] Loading model to the plugin
[ INFO ] Start inference
[ INFO ] Average time: 177.218

[ INFO ] Average time: 76.3372
[ INFO ] Average time: 76.3486
[ INFO ] Average time: 76.3362
Total Inference time: 391981

performance counts:

BoxPredictor_0/BoxEncoding... OPTIMIZED_OUT layerType: Reshape realTime: 0 cpu: 0 execType: Reshape
BoxPredictor_0/BoxEncoding... EXECUTED layerType: Convolution realTime: 153 cpu: 153 execType: MyriadXHwConvolution + injected[Sigmoid]
BoxPredictor_0/BoxEncoding... EXECUTED layerType: Permute realTime: 83 cpu: 83 execType: Permute
BoxPredictor_0/ClassPredic... OPTIMIZED_OUT layerType: Reshape realTime: 0 cpu: 0 execType: Reshape
BoxPredictor_0/ClassPredic... EXECUTED layerType: Convolution realTime: 142 cpu: 142 execType: MyriadXHwConvolution + injected[Permute]
BoxPredictor_0/ClassPredic... EXECUTED layerType: Permute realTime: 114 cpu: 114 execType: Permute
BoxPredictor_1/BoxEncoding... OPTIMIZED_OUT layerType: Reshape realTime: 0 cpu: 0 execType: Reshape
BoxPredictor_1/BoxEncoding... OPTIMIZED_OUT layerType: Permute realTime: 0 cpu: 0 execType: Permute
BoxPredictor_1/BoxEncoding... EXECUTED layerType: Convolution realTime: 78 cpu: 78 execType: MyriadXHwConvolution + injected[Permute]
BoxPredictor_1/BoxEncoding... EXECUTED layerType: Convolution realTime: 52 cpu: 52 execType: MyriadXHwConvolution + injected[Copy]
BoxPredictor_1/BoxEncoding... EXECUTED layerType: Convolution realTime: 50 cpu: 50 execType: MyriadXHwConvolution + injected[Copy]
BoxPredictor_1/BoxEncoding... EXECUTED layerType: Convolution realTime: 49 cpu: 49 execType: MyriadXHwConvolution + injected[Copy]
BoxPredictor_1/BoxEncoding... EXECUTED layerType: Convolution realTime: 50 cpu: 50 execType: MyriadXHwConvolution + injected[Copy]
BoxPredictor_1/ClassPredic... OPTIMIZED_OUT layerType: Reshape realTime: 0 cpu: 0 execType: Reshape
BoxPredictor_1/ClassPredic... OPTIMIZED_OUT layerType: Permute realTime: 0 cpu: 0 execType: Permute
BoxPredictor_1/ClassPredic... EXECUTED layerType: Convolution realTime: 110 cpu: 110 execType: MyriadXHwConvolution + injected[Permute]
BoxPredictor_1/ClassPredic... EXECUTED layerType: Convolution realTime: 101 cpu: 101 execType: MyriadXHwConvolution + injected[Copy]
BoxPredictor_1/ClassPredic... EXECUTED layerType: Convolution realTime: 99 cpu: 99 execType: MyriadXHwConvolution + injected[Copy]
BoxPredictor_1/ClassPredic... EXECUTED layerType: Convolution realTime: 99 cpu: 99 execType: MyriadXHwConvolution + injected[Copy]
BoxPredictor_1/ClassPredic... EXECUTED layerType: Convolution realTime: 100 cpu: 100 execType: MyriadXHwConvolution + injected[Copy]
BoxPredictor_2/BoxEncoding... OPTIMIZED_OUT layerType: Reshape realTime: 0 cpu: 0 execType: Reshape
BoxPredictor_2/BoxEncoding... EXECUTED layerType: Convolution realTime: 42 cpu: 42 execType: MyriadXHwConvolution + injected[Permute]
BoxPredictor_2/BoxEncoding... OPTIMIZED_OUT layerType: Permute realTime: 0 cpu: 0 execType: Permute
BoxPredictor_2/ClassPredic... OPTIMIZED_OUT layerType: Reshape realTime: 0 cpu: 0 execType: Reshape
BoxPredictor_2/ClassPredic... EXECUTED layerType: Convolution realTime: 35 cpu: 35 execType: MyriadXHwConvolution + injected[Permute]
BoxPredictor_2/ClassPredic... OPTIMIZED_OUT layerType: Permute realTime: 0 cpu: 0 execType: Permute
BoxPredictor_3/BoxEncoding... OPTIMIZED_OUT layerType: Reshape realTime: 0 cpu: 0 execType: Reshape
BoxPredictor_3/BoxEncoding... EXECUTED layerType: Convolution realTime: 50 cpu: 50 execType: MyriadXHwConvolution + injected[Permute]
BoxPredictor_3/BoxEncoding... OPTIMIZED_OUT layerType: Permute realTime: 0 cpu: 0 execType: Permute
BoxPredictor_3/ClassPredic... OPTIMIZED_OUT layerType: Reshape realTime: 0 cpu: 0 execType: Reshape
BoxPredictor_3/ClassPredic... EXECUTED layerType: Convolution realTime: 45 cpu: 45 execType: MyriadXHwConvolution + injected[Permute]
BoxPredictor_3/ClassPredic... OPTIMIZED_OUT layerType: Permute realTime: 0 cpu: 0 execType: Permute
BoxPredictor_4/BoxEncoding... OPTIMIZED_OUT layerType: Reshape realTime: 0 cpu: 0 execType: Reshape
BoxPredictor_4/BoxEncoding... EXECUTED layerType: Convolution realTime: 53 cpu: 53 execType: MyriadXHwConvolution + injected[Permute]
BoxPredictor_4/BoxEncoding... OPTIMIZED_OUT layerType: Permute realTime: 0 cpu: 0 execType: Permute
BoxPredictor_4/ClassPredic... OPTIMIZED_OUT layerType: Reshape realTime: 0 cpu: 0 execType: Reshape
BoxPredictor_4/ClassPredic... EXECUTED layerType: Convolution realTime: 23 cpu: 23 execType: MyriadXHwConvolution + injected[Permute]
BoxPredictor_4/ClassPredic... OPTIMIZED_OUT layerType: Permute realTime: 0 cpu: 0 execType: Permute
BoxPredictor_5/BoxEncoding... OPTIMIZED_OUT layerType: Reshape realTime: 0 cpu: 0 execType: Reshape
BoxPredictor_5/BoxEncoding... EXECUTED layerType: Convolution realTime: 29 cpu: 29 execType: MyriadXHwConvolution + injected[Permute]
BoxPredictor_5/BoxEncoding... OPTIMIZED_OUT layerType: Permute realTime: 0 cpu: 0 execType: Permute
BoxPredictor_5/ClassPredic... OPTIMIZED_OUT layerType: Reshape realTime: 0 cpu: 0 execType: Reshape
BoxPredictor_5/ClassPredic... EXECUTED layerType: Convolution realTime: 10 cpu: 10 execType: MyriadXHwConvolution
BoxPredictor_5/ClassPredic... OPTIMIZED_OUT layerType: Permute realTime: 0 cpu: 0 execType: Permute
ConcatPriorBoxesClustered OPTIMIZED_OUT layerType: Concat realTime: 0 cpu: 0 execType: Concat
DetectionOutput EXECUTED layerType: DetectionOutput realTime: 2080 cpu: 2080 execType: DetectionOutput
DetectionOutput@FP16 EXECUTED layerType: <Extra> realTime: 42 cpu: 42 execType: Convert_f16f32
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 105 cpu: 105 execType: CopyMakeBorder
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 333 cpu: 333 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 387 cpu: 387 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 380 cpu: 380 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 332 cpu: 332 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 323 cpu: 323 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 323 cpu: 323 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 324 cpu: 324 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 75 cpu: 75 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 17 cpu: 17 execType: Copy
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 520 cpu: 520 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 754 cpu: 754 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 239 cpu: 239 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 493 cpu: 493 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 779 cpu: 779 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 201 cpu: 201 execType: Copy
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 879 cpu: 879 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 196 cpu: 196 execType: Copy
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 127 cpu: 127 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 85 cpu: 85 execType: Copy
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 779 cpu: 779 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 200 cpu: 200 execType: Copy
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 873 cpu: 873 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 201 cpu: 201 execType: Copy
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 130 cpu: 130 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 13 cpu: 13 execType: Copy
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 85 cpu: 85 execType: Copy
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 551 cpu: 551 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 548 cpu: 548 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 465 cpu: 465 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 1345 cpu: 1345 execType: MyriadXHwConvolution + injected[CopyMakeBorder]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 720 cpu: 720 execType: CopyMakeBorder
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 1339 cpu: 1339 execType: MyriadXHwConvolution + injected[CopyMakeBorder]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 662 cpu: 662 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 431 cpu: 431 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 577 cpu: 577 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 154 cpu: 154 execType: Copy
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 575 cpu: 575 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 585 cpu: 585 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 584 cpu: 584 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 586 cpu: 586 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 578 cpu: 578 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 583 cpu: 583 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 579 cpu: 579 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 584 cpu: 584 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 1412 cpu: 1412 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 511 cpu: 511 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 211 cpu: 211 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 54 cpu: 54 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 480 cpu: 480 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 210 cpu: 210 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 139 cpu: 139 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Eltwise realTime: 71 cpu: 71 execType: Sum
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 316 cpu: 316 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 54 cpu: 54 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 54 cpu: 54 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 54 cpu: 54 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 54 cpu: 54 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 54 cpu: 54 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 721 cpu: 721 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 318 cpu: 318 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 369 cpu: 369 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Eltwise realTime: 71 cpu: 71 execType: Sum
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 307 cpu: 307 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 54 cpu: 54 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 57 cpu: 57 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 54 cpu: 54 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 54 cpu: 54 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 722 cpu: 722 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 306 cpu: 306 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 367 cpu: 367 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 133 cpu: 133 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 24 cpu: 24 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 24 cpu: 24 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 23 cpu: 23 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 23 cpu: 23 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 24 cpu: 24 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 23 cpu: 23 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 24 cpu: 24 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 25 cpu: 25 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 23 cpu: 23 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 24 cpu: 24 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 23 cpu: 23 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 24 cpu: 24 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 24 cpu: 24 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 23 cpu: 23 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 24 cpu: 24 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 24 cpu: 24 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 23 cpu: 23 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 24 cpu: 24 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 722 cpu: 722 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 322 cpu: 322 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 253 cpu: 253 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Eltwise realTime: 48 cpu: 48 execType: Sum
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 185 cpu: 185 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 27 cpu: 27 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 29 cpu: 29 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 29 cpu: 29 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 29 cpu: 29 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 25 cpu: 25 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 29 cpu: 29 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 27 cpu: 27 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 519 cpu: 519 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 184 cpu: 184 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 413 cpu: 413 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Eltwise realTime: 48 cpu: 48 execType: Sum
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 185 cpu: 185 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 29 cpu: 29 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 27 cpu: 27 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 29 cpu: 29 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 29 cpu: 29 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 27 cpu: 27 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 29 cpu: 29 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 27 cpu: 27 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 27 cpu: 27 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 27 cpu: 27 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 27 cpu: 27 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 25 cpu: 25 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 27 cpu: 27 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 29 cpu: 29 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 519 cpu: 519 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 185 cpu: 185 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 413 cpu: 413 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 186 cpu: 186 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 29 cpu: 29 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 25 cpu: 25 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 29 cpu: 29 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 29 cpu: 29 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 27 cpu: 27 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 25 cpu: 25 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 25 cpu: 25 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 29 cpu: 29 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 25 cpu: 25 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 29 cpu: 29 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 26 cpu: 26 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 27 cpu: 27 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 29 cpu: 29 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 28 cpu: 28 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 519 cpu: 519 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 185 cpu: 185 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 479 cpu: 479 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Eltwise realTime: 214 cpu: 214 execType: Sum
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 680 cpu: 680 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 580 cpu: 580 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 643 cpu: 643 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 608 cpu: 608 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 582 cpu: 582 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 573 cpu: 573 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 554 cpu: 554 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 748 cpu: 748 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 749 cpu: 749 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 203 cpu: 203 execType: Copy
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 664 cpu: 664 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 429 cpu: 429 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 230 cpu: 230 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 159 cpu: 159 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 158 cpu: 158 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 157 cpu: 157 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 158 cpu: 158 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 158 cpu: 158 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 539 cpu: 539 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 738 cpu: 738 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 734 cpu: 734 execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 197 cpu: 197 execType: Copy
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 667 cpu: 667 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 121 cpu: 121 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Eltwise realTime: 82 cpu: 82 execType: Sum
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 306 cpu: 306 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 156 cpu: 156 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 156 cpu: 156 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 156 cpu: 156 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 155 cpu: 155 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 156 cpu: 156 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 156 cpu: 156 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 478 cpu: 478 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 308 cpu: 308 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 135 cpu: 135 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Eltwise realTime: 82 cpu: 82 execType: Sum
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 301 cpu: 301 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 156 cpu: 156 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 156 cpu: 156 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 156 cpu: 156 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 156 cpu: 156 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 156 cpu: 156 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 156 cpu: 156 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 478 cpu: 478 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 300 cpu: 300 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 136 cpu: 136 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 107 cpu: 107 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 202 cpu: 202 execType: MyriadXHwConvolution + injected[CopyMakeBorder]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 139 cpu: 139 execType: CopyMakeBorder
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 200 cpu: 200 execType: MyriadXHwConvolution + injected[CopyMakeBorder]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 197 cpu: 197 execType: MyriadXHwConvolution + injected[CopyMakeBorder]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 197 cpu: 197 execType: MyriadXHwConvolution + injected[CopyMakeBorder]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 202 cpu: 202 execType: MyriadXHwConvolution + injected[CopyMakeBorder]
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 77 cpu: 77 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 479 cpu: 479 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 306 cpu: 306 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Eltwise realTime: 58 cpu: 58 execType: Sum
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 209 cpu: 209 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 57 cpu: 57 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 54 cpu: 54 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 54 cpu: 54 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 54 cpu: 54 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 479 cpu: 479 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 211 cpu: 211 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 93 cpu: 93 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Eltwise realTime: 56 cpu: 56 execType: Sum
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 206 cpu: 206 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 54 cpu: 54 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 480 cpu: 480 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 210 cpu: 210 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 95 cpu: 95 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Eltwise realTime: 56 cpu: 56 execType: Sum
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 209 cpu: 209 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 57 cpu: 57 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 56 cpu: 56 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 54 cpu: 54 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 55 cpu: 55 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 481 cpu: 481 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 208 cpu: 208 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 94 cpu: 94 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 258 cpu: 258 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 267 cpu: 267 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 59 cpu: 59 execType: Sum
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 68 cpu: 68 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 31 cpu: 31 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 42 cpu: 42 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 17 cpu: 17 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 42 cpu: 42 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 12 cpu: 12 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 38 cpu: 38 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 477 cpu: 477 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 801 cpu: 801 execType: CopyMakeBorder
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 65 cpu: 65 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 87 cpu: 87 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 40 cpu: 40 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 77 cpu: 77 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 42 cpu: 42 execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 33 cpu: 33 execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED layerType: Convolution realTime: 218 cpu: 218 execType: CopyMakeBorder
FeatureExtractor/Mobilenet... EXECUTED layerType: Clamp realTime: 57 cpu: 57 execType: Clamp
Preprocessor/mul/FusedPower_ EXECUTED layerType: Power realTime: 234 cpu: 234 execType: Power
PriorBoxClustered_0 OPTIMIZED_OUT layerType: PriorBoxClustered realTime: 0 cpu: 0 execType: PriorBoxClustered
PriorBoxClustered_1 OPTIMIZED_OUT layerType: PriorBoxClustered realTime: 0 cpu: 0 execType: PriorBoxClustered
PriorBoxClustered_2 OPTIMIZED_OUT layerType: PriorBoxClustered realTime: 0 cpu: 0 execType: PriorBoxClustered
PriorBoxClustered_3 OPTIMIZED_OUT layerType: PriorBoxClustered realTime: 0 cpu: 0 execType: PriorBoxClustered
PriorBoxClustered_4 OPTIMIZED_OUT layerType: PriorBoxClustered realTime: 0 cpu: 0 execType: PriorBoxClustered
PriorBoxClustered_5 OPTIMIZED_OUT layerType: PriorBoxClustered realTime: 0 cpu: 0 execType: PriorBoxClustered
Receive-Tensor EXECUTED layerType: Receive-Tensor realTime: 0 cpu: 0 execType: Receive-Tensor
concat@0@compact EXECUTED layerType: Concat realTime: 13 cpu: 13 execType: Copy
concat@1@compact EXECUTED layerType: Concat realTime: 10 cpu: 10 execType: Copy
concat@5@compact EXECUTED layerType: Concat realTime: 9 cpu: 9 execType: Copy
concat_1@0@compact EXECUTED layerType: Concat realTime: 14 cpu: 14 execType: Copy
do_ExpandDims_conf OPTIMIZED_OUT layerType: Reshape realTime: 0 cpu: 0 execType: Reshape
do_ExpandDims_conf/sigmoid OPTIMIZED_OUT layerType: sigmoid realTime: 0 cpu: 0 execType: sigmoid
do_reshape_conf OPTIMIZED_OUT layerType: Reshape realTime: 0 cpu: 0 execType: Reshape
do_reshape_loc OPTIMIZED_OUT layerType: Reshape realTime: 0 cpu: 0 execType: Reshape
image_tensor@FP16 EXECUTED layerType: <Extra> realTime: 274 cpu: 274 execType: Convert_u8f16
Total time: 68133 microseconds
[ INFO ] Execution successful

nikos1 · ‎02-08-2019

Great! Thank you!

> Total time: 68133 microseconds

So that means the best we can do is 1000000 / 68133 = 14.6 fps as compute needs 68ms per frame.

That's a bit slower than my MobileNet SSD on NCS2 - will compare tomorrow.

> ssd_mobilenet_v2_coco

Is this the pre-trained SSD from the model zoo or your own version? What is the url to download so that I try your frozen pb model here?

Cheers,

nikos

Lee__Terry · ‎02-08-2019

It's a custom train model based on ssd_mobilenet_v2_coco with 4 classes at the same 300x300.

Would that make a difference?

Directory downloaded is ssd_mobilenet_v2_coco_2018_03_29

https://github.com/tensorflow/models/blob/master/research/object_detection/g3doc/detection_model_zoo.md

nikos1 · ‎02-09-2019

Hi Terry,

> Would that make a difference?

Should not make any difference.

> Directory downloaded is ssd_mobilenet_v2_coco_2018_03_29

Just tested this on Linux + fp16_NCS2 and I get similar time as you ( Total time: 88444 microseconds ). No issue with your 68133 microseconds - looks great and typical for SSD. ( My previous reported SSD faster time was because I was testing a less deep custom version. )

nikos

Lee__Terry · ‎02-09-2019

Hi Nikos,

Thanks a lot for the test.

If that is the case, can we conclude that NCS2 (70 ms ) is much slower than CPU i7 (27 mm based on earlier test)?

I was under the assumption that NCS2 to be faster than CPU.

Terry

nikos1 · ‎02-09-2019

Hi Terry,

NCS2 will be faster than some slow CPUs and slower than fast CPUs. I think the real beauty of NCS2 is its power efficiency. It all depends on your application, use case, and requirements of course. I do not want, for example, to deploy AI at the edge on a quad core CPU system that runs MKDLNN 100% on all cores, in that case 2 x NCS2 may be cheaper and faster. Thermal and fan noise is another consideration in some environments too. Or maybe run some frames on GPU, some on your NCS2 and beat your CPU. We are lucky to have so many options :-)

Cheers,

nikos

Lee__Terry · ‎02-09-2019

Hi Nikos,

It's good to have a better understanding of NCS2's capability. While it's slower than expected, I could deploy it on edge application.

Thanks for all your helps,

Terry