Community
cancel
Showing results for 
Search instead for 
Did you mean: 
Lee__Terry
Beginner
120 Views

Processing time not consistent on openVino async mode with ncs2

Jump to solution

When I run the example "object_detection_demo_ssd_async"

For Sync mode, the processing time is consistent at around 80 ms.

For Async mode, the processing time is not consistent.  frame 0 = 12ms, frame 1 = 130, frame 2 = 12, frame 3 = 120 ......

I have try removing display and I/O. The problem persist.

Is this  this normal ? Any logical explanation ?

The average time on Async mode (70ms) is smaller than the Sync mdoe (80 ms). 

Any thoughts on the issue would be greatly appreciated.

Environment: OpenVino R5,windows 10, video,  ncs2, ssd_mobilenet_v2_coco, object_detection_demo_ssd_async, release mode.

Thanks,
Terry

 

 

 

0 Kudos

Accepted Solutions
nikos1
Valued Contributor I
120 Views

Hello Terry,

I get the same issue as yours. Async can be tricky, you can study the source code to see how this is calculated. Displayed times are just an indication, please feel free to ignore them if you wish. if you really want to see exact measurements you need to use a profiler. A good alternative is to try to use object_detection_demo_ssd_async with the -pc parameter (not in async mode) let it run for a while and the press Esc to exit. Divide 1000000 by the Total time: X  microseconds that is displayed at the terminal. I believe this is a good indication of the maximum fps you can achieve if you feed the inference device fast enough. This number does not vary a lot, does it? Maybe other experts in this forum have more suggestion. I personally use profilers and study detailed timelines.

Cheers,

nikos

View solution in original post

14 Replies
nikos1
Valued Contributor I
121 Views

Hello Terry,

I get the same issue as yours. Async can be tricky, you can study the source code to see how this is calculated. Displayed times are just an indication, please feel free to ignore them if you wish. if you really want to see exact measurements you need to use a profiler. A good alternative is to try to use object_detection_demo_ssd_async with the -pc parameter (not in async mode) let it run for a while and the press Esc to exit. Divide 1000000 by the Total time: X  microseconds that is displayed at the terminal. I believe this is a good indication of the maximum fps you can achieve if you feed the inference device fast enough. This number does not vary a lot, does it? Maybe other experts in this forum have more suggestion. I personally use profilers and study detailed timelines.

Cheers,

nikos

View solution in original post

Lee__Terry
Beginner
120 Views

Hi Nikos,

Thanks for the quick respond and the detail explanation.

I'm still not sure if I got it right. Is 70ms average processing time for  ssd_mobilenet_v2_coco model on tensorflow with NCS2 sound reasonable for resolution of 300x300? 

Terry

nikos1
Valued Contributor I
120 Views

Hi Terry,

> Is 70ms average processing time for  ssd_mobilenet_v2_coco model on tensorflow with NCS2 sound reasonable for resolution of 300x300? 

Not right, that's a bit slow. I am not on Windows (will test later, but Ubuntu NC2 300x300 MB-net-SSD takes less than 35ms for me here.

Could you please run with -pc and post complete output here?  Also include API / build versions, mine are

InferenceEngine: 
	API version ............ 1.4
	Build .................. 19154
[ INFO ] Parsing input parameters
[ INFO ] Reading input
[ INFO ] Loading plugin

	API version ............ 1.5
	Build .................. 19154
	Description ....... myriadPlugin

Cheers,

nikos 

 

Lee__Terry
Beginner
120 Views

Hi Nikos,

While the clock time in on image shows 30ms on image most of the time. The average is 87. I added display for total time/count.

Could you verify that the time you see is average? not the time show on the image display.

Thanks,

Terry

InferenceEngine:
        API version ............ 1.4
        Build .................. 19154
[ INFO ] Parsing input parameters
[ INFO ] Reading input
[ INFO ] Loading plugin

        API version ............ 1.5
        Build .................. 19154
        Description ....... myriadPlugin
[ INFO ] Loading network files
[ INFO ] Batch size is forced to  1.
[ INFO ] Checking that the inputs are as the demo expects
[ INFO ] Checking that the outputs are as the demo expects
[ INFO ] Loading model to the plugin
[ INFO ] Start inference[ INFO ] Average time: 87.3761
[ INFO ] Average time: 87.5408
[ INFO ] Average time: 87.5741
[ INFO ] Average time: 87.7045
[ INFO ] Average time: 87.4694
[ INFO ] Average time: 87.6464
[ INFO ] Average time: 87.4429

nikos1
Valued Contributor I
120 Views

Hi Terry,

In this case looks normal.

BTW could you post your output after using -pc parameter just to make sure?

nikos

Lee__Terry
Beginner
120 Views

Hi Nikos,

Is -pc parameter mean using -d CPU instead of myriad ?

if so, the average time is 27ms. with i7 4 cores computer.

NCS2 is much slower than CUP. What am I missing ?

InferenceEngine:
        API version ............ 1.4
        Build .................. 19154
[ INFO ] Parsing input parameters
[ INFO ] Reading input
[ INFO ] Loading plugin

        API version ............ 1.5
        Build .................. win_20181005
        Description ....... MKLDNNPlugin
[ INFO ] Loading network files
[ INFO ] Batch size is forced to  1.
[ INFO ] Checking that the inputs are as the demo expects
[ INFO ] Checking that the outputs are as the demo expects
[ INFO ] Loading model to the plugin
[ INFO ] Start inference

 

nikos1
Valued Contributor I
120 Views

> Is -pc parameter mean using -d CPU instead of myriad ?

Still using MYRIAD with -pc but report the performance counters per layer.

Could you attach the complete command and also output please?

Still using -d MYRIAD but add -pc like for example

object_detection_demo_ssd_async -i some_test_clip.mp4  -m your_ssd.xml -D MYRIAD -pc

 

Lee__Terry
Beginner
120 Views

I did not know about the -pc option. Thanks.

-i c:\t\s2\t1.avi -m C:\t\y11\IR\frozen_inference_graph.xml -d MYRIAD -pc -t 0.5

on project: object_detection_demo_ssd_async

 

 

Report

InferenceEngine:
        API version ............ 1.4
        Build .................. 19154
[ INFO ] Parsing input parameters
[ INFO ] Reading input
[ INFO ] Loading plugin

        API version ............ 1.5
        Build .................. 19154
        Description ....... myriadPlugin
[ INFO ] Loading network files
[ INFO ] Batch size is forced to  1.
[ INFO ] Checking that the inputs are as the demo expects
[ INFO ] Checking that the outputs are as the demo expects
[ INFO ] Loading model to the plugin
[ INFO ] Start inference
[ INFO ] Average time: 177.218

[ INFO ] Average time: 76.3372
[ INFO ] Average time: 76.3486
[ INFO ] Average time: 76.3362
Total Inference time: 391981

performance counts:

BoxPredictor_0/BoxEncoding... OPTIMIZED_OUT  layerType: Reshape            realTime: 0          cpu: 0              execType: Reshape
BoxPredictor_0/BoxEncoding... EXECUTED       layerType: Convolution        realTime: 153        cpu: 153            execType: MyriadXHwConvolution + injected[Sigmoid]
BoxPredictor_0/BoxEncoding... EXECUTED       layerType: Permute            realTime: 83         cpu: 83             execType: Permute
BoxPredictor_0/ClassPredic... OPTIMIZED_OUT  layerType: Reshape            realTime: 0          cpu: 0              execType: Reshape
BoxPredictor_0/ClassPredic... EXECUTED       layerType: Convolution        realTime: 142        cpu: 142            execType: MyriadXHwConvolution + injected[Permute]
BoxPredictor_0/ClassPredic... EXECUTED       layerType: Permute            realTime: 114        cpu: 114            execType: Permute
BoxPredictor_1/BoxEncoding... OPTIMIZED_OUT  layerType: Reshape            realTime: 0          cpu: 0              execType: Reshape
BoxPredictor_1/BoxEncoding... OPTIMIZED_OUT  layerType: Permute            realTime: 0          cpu: 0              execType: Permute
BoxPredictor_1/BoxEncoding... EXECUTED       layerType: Convolution        realTime: 78         cpu: 78             execType: MyriadXHwConvolution + injected[Permute]
BoxPredictor_1/BoxEncoding... EXECUTED       layerType: Convolution        realTime: 52         cpu: 52             execType: MyriadXHwConvolution + injected[Copy]
BoxPredictor_1/BoxEncoding... EXECUTED       layerType: Convolution        realTime: 50         cpu: 50             execType: MyriadXHwConvolution + injected[Copy]
BoxPredictor_1/BoxEncoding... EXECUTED       layerType: Convolution        realTime: 49         cpu: 49             execType: MyriadXHwConvolution + injected[Copy]
BoxPredictor_1/BoxEncoding... EXECUTED       layerType: Convolution        realTime: 50         cpu: 50             execType: MyriadXHwConvolution + injected[Copy]
BoxPredictor_1/ClassPredic... OPTIMIZED_OUT  layerType: Reshape            realTime: 0          cpu: 0              execType: Reshape
BoxPredictor_1/ClassPredic... OPTIMIZED_OUT  layerType: Permute            realTime: 0          cpu: 0              execType: Permute
BoxPredictor_1/ClassPredic... EXECUTED       layerType: Convolution        realTime: 110        cpu: 110            execType: MyriadXHwConvolution + injected[Permute]
BoxPredictor_1/ClassPredic... EXECUTED       layerType: Convolution        realTime: 101        cpu: 101            execType: MyriadXHwConvolution + injected[Copy]
BoxPredictor_1/ClassPredic... EXECUTED       layerType: Convolution        realTime: 99         cpu: 99             execType: MyriadXHwConvolution + injected[Copy]
BoxPredictor_1/ClassPredic... EXECUTED       layerType: Convolution        realTime: 99         cpu: 99             execType: MyriadXHwConvolution + injected[Copy]
BoxPredictor_1/ClassPredic... EXECUTED       layerType: Convolution        realTime: 100        cpu: 100            execType: MyriadXHwConvolution + injected[Copy]
BoxPredictor_2/BoxEncoding... OPTIMIZED_OUT  layerType: Reshape            realTime: 0          cpu: 0              execType: Reshape
BoxPredictor_2/BoxEncoding... EXECUTED       layerType: Convolution        realTime: 42         cpu: 42             execType: MyriadXHwConvolution + injected[Permute]
BoxPredictor_2/BoxEncoding... OPTIMIZED_OUT  layerType: Permute            realTime: 0          cpu: 0              execType: Permute
BoxPredictor_2/ClassPredic... OPTIMIZED_OUT  layerType: Reshape            realTime: 0          cpu: 0              execType: Reshape
BoxPredictor_2/ClassPredic... EXECUTED       layerType: Convolution        realTime: 35         cpu: 35             execType: MyriadXHwConvolution + injected[Permute]
BoxPredictor_2/ClassPredic... OPTIMIZED_OUT  layerType: Permute            realTime: 0          cpu: 0              execType: Permute
BoxPredictor_3/BoxEncoding... OPTIMIZED_OUT  layerType: Reshape            realTime: 0          cpu: 0              execType: Reshape
BoxPredictor_3/BoxEncoding... EXECUTED       layerType: Convolution        realTime: 50         cpu: 50             execType: MyriadXHwConvolution + injected[Permute]
BoxPredictor_3/BoxEncoding... OPTIMIZED_OUT  layerType: Permute            realTime: 0          cpu: 0              execType: Permute
BoxPredictor_3/ClassPredic... OPTIMIZED_OUT  layerType: Reshape            realTime: 0          cpu: 0              execType: Reshape
BoxPredictor_3/ClassPredic... EXECUTED       layerType: Convolution        realTime: 45         cpu: 45             execType: MyriadXHwConvolution + injected[Permute]
BoxPredictor_3/ClassPredic... OPTIMIZED_OUT  layerType: Permute            realTime: 0          cpu: 0              execType: Permute
BoxPredictor_4/BoxEncoding... OPTIMIZED_OUT  layerType: Reshape            realTime: 0          cpu: 0              execType: Reshape
BoxPredictor_4/BoxEncoding... EXECUTED       layerType: Convolution        realTime: 53         cpu: 53             execType: MyriadXHwConvolution + injected[Permute]
BoxPredictor_4/BoxEncoding... OPTIMIZED_OUT  layerType: Permute            realTime: 0          cpu: 0              execType: Permute
BoxPredictor_4/ClassPredic... OPTIMIZED_OUT  layerType: Reshape            realTime: 0          cpu: 0              execType: Reshape
BoxPredictor_4/ClassPredic... EXECUTED       layerType: Convolution        realTime: 23         cpu: 23             execType: MyriadXHwConvolution + injected[Permute]
BoxPredictor_4/ClassPredic... OPTIMIZED_OUT  layerType: Permute            realTime: 0          cpu: 0              execType: Permute
BoxPredictor_5/BoxEncoding... OPTIMIZED_OUT  layerType: Reshape            realTime: 0          cpu: 0              execType: Reshape
BoxPredictor_5/BoxEncoding... EXECUTED       layerType: Convolution        realTime: 29         cpu: 29             execType: MyriadXHwConvolution + injected[Permute]
BoxPredictor_5/BoxEncoding... OPTIMIZED_OUT  layerType: Permute            realTime: 0          cpu: 0              execType: Permute
BoxPredictor_5/ClassPredic... OPTIMIZED_OUT  layerType: Reshape            realTime: 0          cpu: 0              execType: Reshape
BoxPredictor_5/ClassPredic... EXECUTED       layerType: Convolution        realTime: 10         cpu: 10             execType: MyriadXHwConvolution
BoxPredictor_5/ClassPredic... OPTIMIZED_OUT  layerType: Permute            realTime: 0          cpu: 0              execType: Permute
ConcatPriorBoxesClustered     OPTIMIZED_OUT  layerType: Concat             realTime: 0          cpu: 0              execType: Concat
DetectionOutput               EXECUTED       layerType: DetectionOutput    realTime: 2080       cpu: 2080           execType: DetectionOutput
DetectionOutput@FP16          EXECUTED       layerType: <Extra>            realTime: 42         cpu: 42             execType: Convert_f16f32
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 105        cpu: 105            execType: CopyMakeBorder
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 333        cpu: 333            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 387        cpu: 387            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 380        cpu: 380            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 332        cpu: 332            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 323        cpu: 323            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 323        cpu: 323            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 324        cpu: 324            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 75         cpu: 75             execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 17         cpu: 17             execType: Copy
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 520        cpu: 520            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 754        cpu: 754            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 239        cpu: 239            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 493        cpu: 493            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 779        cpu: 779            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 201        cpu: 201            execType: Copy
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 879        cpu: 879            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 196        cpu: 196            execType: Copy
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 127        cpu: 127            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 85         cpu: 85             execType: Copy
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 779        cpu: 779            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 200        cpu: 200            execType: Copy
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 873        cpu: 873            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 201        cpu: 201            execType: Copy
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 130        cpu: 130            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 13         cpu: 13             execType: Copy
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 85         cpu: 85             execType: Copy
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 551        cpu: 551            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 548        cpu: 548            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 465        cpu: 465            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 1345       cpu: 1345           execType: MyriadXHwConvolution + injected[CopyMakeBorder]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 720        cpu: 720            execType: CopyMakeBorder
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 1339       cpu: 1339           execType: MyriadXHwConvolution + injected[CopyMakeBorder]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 662        cpu: 662            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 431        cpu: 431            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 577        cpu: 577            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 154        cpu: 154            execType: Copy
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 575        cpu: 575            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 585        cpu: 585            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 584        cpu: 584            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 586        cpu: 586            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 578        cpu: 578            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 583        cpu: 583            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 579        cpu: 579            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 584        cpu: 584            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 1412       cpu: 1412           execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 511        cpu: 511            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 211        cpu: 211            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 54         cpu: 54             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 480        cpu: 480            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 210        cpu: 210            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 139        cpu: 139            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Eltwise            realTime: 71         cpu: 71             execType: Sum
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 316        cpu: 316            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 54         cpu: 54             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 54         cpu: 54             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 54         cpu: 54             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 54         cpu: 54             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 54         cpu: 54             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 721        cpu: 721            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 318        cpu: 318            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 369        cpu: 369            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Eltwise            realTime: 71         cpu: 71             execType: Sum
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 307        cpu: 307            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 54         cpu: 54             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 57         cpu: 57             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 54         cpu: 54             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 54         cpu: 54             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 722        cpu: 722            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 306        cpu: 306            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 367        cpu: 367            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 133        cpu: 133            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 24         cpu: 24             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 24         cpu: 24             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 23         cpu: 23             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 23         cpu: 23             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 24         cpu: 24             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 23         cpu: 23             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 24         cpu: 24             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 25         cpu: 25             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 23         cpu: 23             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 24         cpu: 24             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 23         cpu: 23             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 24         cpu: 24             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 24         cpu: 24             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 23         cpu: 23             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 24         cpu: 24             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 24         cpu: 24             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 23         cpu: 23             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 24         cpu: 24             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 722        cpu: 722            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 322        cpu: 322            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 253        cpu: 253            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Eltwise            realTime: 48         cpu: 48             execType: Sum
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 185        cpu: 185            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 27         cpu: 27             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 29         cpu: 29             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 29         cpu: 29             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 29         cpu: 29             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 25         cpu: 25             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 29         cpu: 29             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 27         cpu: 27             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 519        cpu: 519            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 184        cpu: 184            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 413        cpu: 413            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Eltwise            realTime: 48         cpu: 48             execType: Sum
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 185        cpu: 185            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 29         cpu: 29             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 27         cpu: 27             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 29         cpu: 29             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 29         cpu: 29             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 27         cpu: 27             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 29         cpu: 29             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 27         cpu: 27             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 27         cpu: 27             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 27         cpu: 27             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 27         cpu: 27             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 25         cpu: 25             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 27         cpu: 27             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 29         cpu: 29             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 519        cpu: 519            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 185        cpu: 185            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 413        cpu: 413            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 186        cpu: 186            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 29         cpu: 29             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 25         cpu: 25             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 29         cpu: 29             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 29         cpu: 29             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 27         cpu: 27             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 25         cpu: 25             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 25         cpu: 25             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 29         cpu: 29             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 25         cpu: 25             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 29         cpu: 29             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 26         cpu: 26             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 27         cpu: 27             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 29         cpu: 29             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 28         cpu: 28             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 519        cpu: 519            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 185        cpu: 185            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 479        cpu: 479            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Eltwise            realTime: 214        cpu: 214            execType: Sum
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 680        cpu: 680            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 580        cpu: 580            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 643        cpu: 643            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 608        cpu: 608            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 582        cpu: 582            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 573        cpu: 573            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 554        cpu: 554            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 748        cpu: 748            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 749        cpu: 749            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 203        cpu: 203            execType: Copy
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 664        cpu: 664            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 429        cpu: 429            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 230        cpu: 230            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 159        cpu: 159            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 158        cpu: 158            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 157        cpu: 157            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 158        cpu: 158            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 158        cpu: 158            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 539        cpu: 539            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 738        cpu: 738            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 734        cpu: 734            execType: MyriadXHwConvolution + injected[Copy]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 197        cpu: 197            execType: Copy
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 667        cpu: 667            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 121        cpu: 121            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Eltwise            realTime: 82         cpu: 82             execType: Sum
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 306        cpu: 306            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 156        cpu: 156            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 156        cpu: 156            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 156        cpu: 156            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 155        cpu: 155            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 156        cpu: 156            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 156        cpu: 156            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 478        cpu: 478            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 308        cpu: 308            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 135        cpu: 135            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Eltwise            realTime: 82         cpu: 82             execType: Sum
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 301        cpu: 301            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 156        cpu: 156            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 156        cpu: 156            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 156        cpu: 156            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 156        cpu: 156            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 156        cpu: 156            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 156        cpu: 156            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 478        cpu: 478            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 300        cpu: 300            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 136        cpu: 136            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 107        cpu: 107            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 202        cpu: 202            execType: MyriadXHwConvolution + injected[CopyMakeBorder]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 139        cpu: 139            execType: CopyMakeBorder
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 200        cpu: 200            execType: MyriadXHwConvolution + injected[CopyMakeBorder]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 197        cpu: 197            execType: MyriadXHwConvolution + injected[CopyMakeBorder]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 197        cpu: 197            execType: MyriadXHwConvolution + injected[CopyMakeBorder]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 202        cpu: 202            execType: MyriadXHwConvolution + injected[CopyMakeBorder]
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 77         cpu: 77             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 479        cpu: 479            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 306        cpu: 306            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Eltwise            realTime: 58         cpu: 58             execType: Sum
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 209        cpu: 209            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 57         cpu: 57             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 54         cpu: 54             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 54         cpu: 54             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 54         cpu: 54             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 479        cpu: 479            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 211        cpu: 211            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 93         cpu: 93             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Eltwise            realTime: 56         cpu: 56             execType: Sum
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 206        cpu: 206            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 54         cpu: 54             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 480        cpu: 480            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 210        cpu: 210            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 95         cpu: 95             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Eltwise            realTime: 56         cpu: 56             execType: Sum
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 209        cpu: 209            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 57         cpu: 57             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 56         cpu: 56             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 54         cpu: 54             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 55         cpu: 55             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 481        cpu: 481            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 208        cpu: 208            execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 94         cpu: 94             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 258        cpu: 258            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 267        cpu: 267            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 59         cpu: 59             execType: Sum
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 68         cpu: 68             execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 31         cpu: 31             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 42         cpu: 42             execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 17         cpu: 17             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 42         cpu: 42             execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 12         cpu: 12             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 38         cpu: 38             execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 477        cpu: 477            execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 801        cpu: 801            execType: CopyMakeBorder
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 65         cpu: 65             execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 87         cpu: 87             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 40         cpu: 40             execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 77         cpu: 77             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 42         cpu: 42             execType: Clamp
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 33         cpu: 33             execType: MyriadXHwConvolution
FeatureExtractor/Mobilenet... EXECUTED       layerType: Convolution        realTime: 218        cpu: 218            execType: CopyMakeBorder
FeatureExtractor/Mobilenet... EXECUTED       layerType: Clamp              realTime: 57         cpu: 57             execType: Clamp
Preprocessor/mul/FusedPower_  EXECUTED       layerType: Power              realTime: 234        cpu: 234            execType: Power
PriorBoxClustered_0           OPTIMIZED_OUT  layerType: PriorBoxClustered  realTime: 0          cpu: 0              execType: PriorBoxClustered
PriorBoxClustered_1           OPTIMIZED_OUT  layerType: PriorBoxClustered  realTime: 0          cpu: 0              execType: PriorBoxClustered
PriorBoxClustered_2           OPTIMIZED_OUT  layerType: PriorBoxClustered  realTime: 0          cpu: 0              execType: PriorBoxClustered
PriorBoxClustered_3           OPTIMIZED_OUT  layerType: PriorBoxClustered  realTime: 0          cpu: 0              execType: PriorBoxClustered
PriorBoxClustered_4           OPTIMIZED_OUT  layerType: PriorBoxClustered  realTime: 0          cpu: 0              execType: PriorBoxClustered
PriorBoxClustered_5           OPTIMIZED_OUT  layerType: PriorBoxClustered  realTime: 0          cpu: 0              execType: PriorBoxClustered
Receive-Tensor                EXECUTED       layerType: Receive-Tensor     realTime: 0          cpu: 0              execType: Receive-Tensor
concat@0@compact              EXECUTED       layerType: Concat             realTime: 13         cpu: 13             execType: Copy
concat@1@compact              EXECUTED       layerType: Concat             realTime: 10         cpu: 10             execType: Copy
concat@5@compact              EXECUTED       layerType: Concat             realTime: 9          cpu: 9              execType: Copy
concat_1@0@compact            EXECUTED       layerType: Concat             realTime: 14         cpu: 14             execType: Copy
do_ExpandDims_conf            OPTIMIZED_OUT  layerType: Reshape            realTime: 0          cpu: 0              execType: Reshape
do_ExpandDims_conf/sigmoid    OPTIMIZED_OUT  layerType: sigmoid            realTime: 0          cpu: 0              execType: sigmoid
do_reshape_conf               OPTIMIZED_OUT  layerType: Reshape            realTime: 0          cpu: 0              execType: Reshape
do_reshape_loc                OPTIMIZED_OUT  layerType: Reshape            realTime: 0          cpu: 0              execType: Reshape
image_tensor@FP16             EXECUTED       layerType: <Extra>            realTime: 274        cpu: 274            execType: Convert_u8f16
Total time: 68133    microseconds
[ INFO ] Execution successful

 

nikos1
Valued Contributor I
120 Views

Great! Thank you!

> Total time: 68133    microseconds

So that means the best we can do is 1000000 / 68133    = 14.6 fps as compute needs 68ms per frame.

That's a bit slower than my MobileNet SSD on NCS2 - will compare tomorrow.

> ssd_mobilenet_v2_coco

Is this the pre-trained SSD from the model zoo or your own version? What is the url to download so that I try your frozen pb model here?

Cheers,

nikos

Lee__Terry
Beginner
120 Views

It's a custom train model based on  ssd_mobilenet_v2_coco with 4 classes at the same 300x300. 

Would that make a difference?

Directory downloaded is ssd_mobilenet_v2_coco_2018_03_29

https://github.com/tensorflow/models/blob/master/research/object_detection/g3doc/detection_model_zoo...

nikos1
Valued Contributor I
120 Views

Hi Terry,

> Would that make a difference?

Should not make any difference.

> Directory downloaded is ssd_mobilenet_v2_coco_2018_03_29

Just tested this on Linux + fp16_NCS2 and I get similar time as you ( Total time: 88444    microseconds ). No issue with your 68133    microseconds - looks great and typical for SSD.  ( My previous reported SSD faster time was because I was testing a less deep custom version. )

nikos

 

Lee__Terry
Beginner
120 Views

Hi Nikos,

Thanks a lot for the test. 

If that is the case, can we conclude that NCS2 (70 ms ) is much slower than CPU i7 (27 mm based on earlier test)?

I was under the assumption that  NCS2 to be faster than CPU.

Terry

nikos1
Valued Contributor I
120 Views

Hi Terry,

NCS2 will be faster than some slow CPUs and slower than fast CPUs. I think the real beauty of NCS2 is its power efficiency. It all depends on your application, use case, and requirements of course. I do not want, for example, to deploy AI at the edge on a quad core CPU system that runs MKDLNN 100% on all cores, in that case 2 x NCS2 may be cheaper and faster. Thermal and fan noise is another consideration in some environments too. Or maybe run some frames on GPU, some on your NCS2 and beat your CPU.  We are lucky to have so many options :-)

Cheers,

nikos

Lee__Terry
Beginner
120 Views

Hi Nikos,

It's good to have a better understanding of  NCS2's capability. While it's slower than expected, I could deploy it on edge application.

Thanks for all your helps,

Terry