Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.
6404 Discussions

[Bug?] mvNCCheck ignores -M and -S switches?

idata
Employee
805 Views

Not sure about this, but mvNCCheck seems to ignore the -M and -S switches. If I use "-S 4 -M 8" I get exactly the same as output as when I ommit the switches. Proof:

 

python3 ./mvNCCheck.pyc network.prototxt -w network.caffemodel -S 4 -M 8

 

mvNCCheck v02.00, Copyright @ Movidius Ltd 2016

 

USB: Transferring Data…

 

USB: Myriad Execution Finished

 

USB: Myriad Connection Closing.

 

USB: Myriad Connection Closed.

 

Result: (1, 8)

 

1) 6 1.0

 

2) 7 0.0

 

3) 5 0.0

 

4) 4 0.0

 

5) 3 0.0

 

Expected: (8,)

 

1) 6 1.0

 

2) 3 2.8312e-05

 

3) 7 0.0

 

4) 5 0.0

 

5) 4 0.0

 

Obtained values

 

Obtained Min Pixel Accuracy: 0.0028312206268310547% (max allowed=2%), Pass

 

Obtained Average Pixel Accuracy: 0.00035390257835388184% (max allowed=1%), Pass

 

Obtained Percentage of wrong values: 0.0% (max allowed=0%), Pass

 

Obtained Pixel-wise L2 error: 0.0010009876521337331% (max allowed=1%), Pass

 

Obtained Global Sum Difference: 2.8312206268310547e-05

 

python3 ./mvNCCheck.pyc network.prototxt -w network.caffemodel

 

mvNCCheck v02.00, Copyright @ Movidius Ltd 2016

 

USB: Transferring Data…

 

USB: Myriad Execution Finished

 

USB: Myriad Connection Closing.

 

USB: Myriad Connection Closed.

 

Result: (1, 8)

 

1) 6 1.0

 

2) 7 0.0

 

3) 5 0.0

 

4) 4 0.0

 

5) 3 0.0

 

Expected: (8,)

 

1) 6 1.0

 

2) 3 2.8312e-05

 

3) 7 0.0

 

4) 5 0.0

 

5) 4 0.0

 

Obtained values

 

Obtained Min Pixel Accuracy: 0.0028312206268310547% (max allowed=2%), Pass

 

Obtained Average Pixel Accuracy: 0.00035390257835388184% (max allowed=1%), Pass

 

Obtained Percentage of wrong values: 0.0% (max allowed=0%), Pass

 

Obtained Pixel-wise L2 error: 0.0010009876521337331% (max allowed=1%), Pass

 

Obtained Global Sum Difference: 2.8312206268310547e-05
0 Kudos
3 Replies
idata
Employee
495 Views

@Bug80 For mvNCCheck.py, the options -S and -M only come to play when an image is used as input. When using the mvNCCheck.py program with the -S and -M options, try using the -i option to specify a test image for the network you are checking.

0 Kudos
idata
Employee
495 Views

Well, that's going to be a problem, because I am not using images as input ;) Is there a way to scale the test inputs without using images?

 

Of course, in the end a user would like to test the network within the input working range. Outside of that range, the network can give strange results but that does not necessarily mean that the network (or the conversion to a graph file) is not working.

0 Kudos
idata
Employee
495 Views

_bump_ Is there anyone who knows a workaround for this issue, of if a future release will support test input scaling without using a test image?

0 Kudos
Reply