Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.
6403 Discussions

ncappzoo build get [Fail] with Obtained value

idata
Employee
603 Views

ncsdk has been built in Ubuntu 16.04 x64. ncappzoo is build with make, with one NCS is pluged in.

 

When build TensorFlow InceptionV2, I get some [Fail] logs as follows (I don't change anything):

 

A.

 

… …

 

make[2]: Entering directory '/home/guan/NCS/ncappzoo/tensorflow/inception_v2'

 

… …

 

Generating Profile Report 'output_report.html'…

 

… …

 

USB: Transferring Data…

 

USB: Myriad Execution Finished

 

USB: Myriad Connection Closing.

 

USB: Myriad Connection Closed.

 

Result: (1, 1, 1001)

 

1) 1000 nan

 

2) 328 nan

 

3) 341 nan

 

4) 340 nan

 

5) 339 nan

 

Expected: (1, 1001)

 

1) 947 0.999625

 

2) 808 0.000375067

 

3) 791 1.48096e-09

 

4) 229 1.08099e-11

 

5) 790 3.16383e-13

 

/usr/local/bin/ncsdk/Controllers/Metrics.py:75: RuntimeWarning: invalid value encountered in greater

 

diff)) / total_values * 100

 

Obtained values

 

Obtained Min Pixel Accuracy: nan% (max allowed=2%), Fail

 

Obtained Average Pixel Accuracy: nan% (max allowed=1%), Fail

 

Obtained Percentage of wrong values: 0.0% (max allowed=0%), Fail

 

Obtained Pixel-wise L2 error: nan% (max allowed=1%), Fail

 

Obtained Global Sum Difference: nan

 

/usr/local/bin/ncsdk/Controllers/Metrics.py:75: RuntimeWarning: invalid value encountered in greater

 

diff)) / total_values * 100 seems to be the underlying problem… I guess.

 

B.

 

… …

 

make[2]: Entering directory '/home/guan/NCS/ncappzoo/tensorflow/mobilenets'

 

… …

 

Generating Profile Report 'output_report.html'…

 

… …

 

USB: Transferring Data…

 

USB: Myriad Execution Finished

 

USB: Myriad Connection Closing.

 

USB: Myriad Connection Closed.

 

Result: (1, 1, 1001)

 

1) 600 0.77051

 

2) 886 0.06131

 

3) 905 0.053284

 

4) 893 0.018265

 

5) 906 0.0092926

 

Expected: (1, 1001)

 

1) 600 0.723252

 

2) 886 0.0944978

 

3) 905 0.0332514

 

4) 893 0.022707

 

5) 790 0.0145219

 

Obtained values

 

Obtained Min Pixel Accuracy: 6.53381422162056% (max allowed=2%), Fail

 

Obtained Average Pixel Accuracy: 0.02274659782415256% (max allowed=1%), Pass

 

Obtained Percentage of wrong values: 0.2997002997002997% (max allowed=0%), Fail

 

Obtained Pixel-wise L2 error: 0.2732927306157317% (max allowed=1%), Pass

 

Obtained Global Sum Difference: 0.16467970609664917

 

Here I get 2 Fail and 2 Pass.

 

I have built it twice and the problem is always the same. Is it some BUGs in ncappzoo?

0 Kudos
1 Reply
idata
Employee
340 Views

@iceguan You're right about a bug in the ncappzoo example. Thanks for bringing this to our attention.

0 Kudos
Reply