Run asl_recognition_demo Error in tracker.py line 18 ModuleNotFoundError: No module named 'scipy'

[Chiu__Hsien_Hsiang]

Hi,

Have followed the ASL Open Model demo page

https://github.com/openvinotoolkit/open_model_zoo/tree/master/demos/python_demos/asl_recognition_demo#running

ASL Recognition Python* Demo

and the commands:

python asl_recognition_demo.py \
-m_a /home/user/asl-recognition-0003.xml \
-m_d /home/user/person-detection-asl-0001.xml \
-i 0 \
-c ./classes.json

PC is using OS: Windows 10, 

Command Prompt Run as Administrator

setupvars.bat set correct

asl-recognition-0004 download 2021.1.110 updated.

person-detection-asl-0001 download 2021.1.110 updated. 

Video camera ok

Once Run the python asl ... command, it display Error message:

"

Traceback (most recent call last):
File "asl_recognition_demo.py", line 32, in <module>
from asl_recognition_demo.tracker import Tracker
File "C:\Program Files (x86)\IntelSWTools\openvino_2021.1.110\deployment_tools\open_model_zoo\demos\python_demos\asl_recognition_demo\asl_recognition_demo\tracker.py", line 18, in <module>
from scipy.optimize import linear_sum_assignment
ModuleNotFoundError: No module named 'scipy'

"

Attached screen picture Command Prompt with Error message for reference

Does someone know how to solve the error? Able to Run the asl_recognition_demo?

[Iffa_Intel · Accepted solution]

Greetings,

Make sure that you had run setupvars each time you open a new terminal/cmd.

The error ModuleNotFoundError: No module named 'scipy' could be that you didn't install scipy, try to install it: pip install scipy.

Sincerely,

Iffa

[Chiu__Hsien_Hsiang]

Hi Iffa,

Thank you for reply, I have followed instructions and install scipy.

The missing module name 'scipy' error has solved.

attached CMD screen picture for reference 

Solution steps:

1. Setupvars.bat

and

2.  pip install scipy

Have another error, Demo Screen shows black screen:

(in video_stream.py", line 123, in _frame_generator
trg_time_step = 1.0 / float(source_fps)
ZeroDivisionError: float division by zero)

After install scipy, move all the xml, bin files in same directory

Run asl_recognition_demo.py Demo again,

C:\Program Files (x86)\IntelSWTools\openvino_2021.1.110\deployment_tools\open_model_zoo\demos\python_demos\asl_recognition_demo>python asl_recognition_demo.py -m_a asl-recognition-0004.xml -m_d person-detection-asl-0001.xml -i 1 -c classes.json

and

have another Error when use Video Camera as "-i 1" source.  (my PC use video camera 1 as source)

the Demo windows will display "Back" screen, no video images ...etc.

on CMD screen shows message 

"

Process Process-1:
Traceback (most recent call last):
File "C:\Users\User\AppData\Local\Programs\Python\Python36\lib\multiprocessing\process.py", line 258, in _bootstrap
self.run()
File "C:\Users\User\AppData\Local\Programs\Python\Python36\lib\multiprocessing\process.py", line 93, in run
self._target(*self._args, **self._kwargs)
File "C:\Program Files (x86)\IntelSWTools\openvino_2021.1.110\deployment_tools\open_model_zoo\demos\python_demos\asl_recognition_demo\asl_recognition_demo\video_stream.py", line 123, in _frame_generator
trg_time_step = 1.0 / float(source_fps)
ZeroDivisionError: float division by zero

"

and the pop up Demo screen is Black screen. Program keep running , but Black screen, not show anything. When Click "ESC" key the Demo window program will terminated back to CMD window.

Attached Demo Windows screen show Black screen error picture for reference.

Does someone know How to solve this error?

Demo windows shows black screen , no images display.

in CMD display "

video_stream.py", line 123, in _frame_generator
trg_time_step = 1.0 / float(source_fps)
ZeroDivisionError: float division by zero

"

Program do not crash, still running, but demo windows has no image.

When click ESC key, will terminated windows and back to CMD windows prompt.

[Iffa_Intel]

Greetings,

We are currently investigating your new issue. We will update you asap.

Thanks!

Sincerely,

Iffa

[Chiu__Hsien_Hsiang]

Hi Iffa,

Thank you for reply message.

Here are Environment Details details information of 1. version of the OpenVINO™ toolkit version,2. Operating System , 3. Hardware specifications,4. Additional environment information, and 5. Steps to reproduce, information, for reference:

Environment Details

1. Which version of the OpenVINO™ toolkit are you using?

Using openvino_2021.1.110 version

2. Operating System

Windows 10 Pro 64 bits,
Version: 1909

3. Hardware specifications

System:
Processor: Intel(R) Core(TM) i7-10510U CPU @ 1.8GHz 2.30 GHz
Installed memory (RAM): 16.0 GB
System type: 64-bit Operating System, x64-based processor

4. Additional environment information

Video Camera:
Intel RealSense(TM) Depth Camera 415 RGB
Intel RealSense(TM) Depth Camera 415 Depth

CMAKE version 3.18.0-rc2

Python 3.6.5

C:\Users\User>pip -V
pip 20.3 from c:\users\user\appdata\local\programs\python\python36\lib\site-packages\pip (python 3.6)

5. Steps to reproduce

Here are the details steps:

CMD run as Admin

Step 1.

C:\Program Files (x86)\IntelSWTools\openvino_2021.1.110\bin
Run setupvars.bat

Step 2.

Have use Open_Model_Zoo downloader to Download newest asl .xml and .bin fies, using FP32 files to Run

C:\Program Files (x86)\IntelSWTools\openvino_2021.1.110\deployment_tools\open_model_zoo\tools\downloader\intel\asl-recognition-0004\FP32

asl-recognition-0004.XML
asl-recognition-0004.bin

Step 3.

The application is original from OpenViNO_2021.1.110 installation
C:\Program Files (x86)\IntelSWTools\openvino_2021.1.110\deployment_tools\open_model_zoo\demos\python_demos\asl_recognition_demo

Step 4.

Have moved the asl .xml and .bin files to same directory

PC connect USB with RealSense Camera is 1

Step 5.

In CMD Run command:
C:\Program Files
(x86)\IntelSWTools\openvino_2021.1.110\deployment_tools\open_model_zoo\demos\python_demos\asl_recognition_demo>python
asl_recognition_demo.py -m_a asl-recognition-0004.xml -m_d
person-detection-asl-0001.xml -i 1 -c classes.json

Step 6.

Program Demo Window Black Screen Error:

Program Run but the pop up Demo window only display black screen, no image.

During the program run
The CMD windows shows message:
"
Process Process-1:Traceback (most recent call last):File
"C:\Users\User\AppData\Local\Programs\Python\Python36\lib\multiprocessing\process.py",
line 258, in _bootstrapself.run()File
"C:\Users\User\AppData\Local\Programs\Python\Python36\lib\multiprocessing\process.py",
line 93, in runself._target(*self._args, **self._kwargs)File "C:\Program
Files
(x86)\IntelSWTools\openvino_2021.1.110\deployment_tools\open_model_zoo\demos\python_demos\asl_recognition_demo\asl_recognition_demo\video_stream.py",
line 123, in _frame_generatortrg_time_step = 1.0 /
float(source_fps)ZeroDivisionError: float division by zero

"

Step 7.

Program No crash, when click ESC key, then program will terminated, and back to CMD windows prompt.

[Chiu__Hsien_Hsiang]

Hi Iffa,

Have received Rizal reply solution from another post, and the solution is to change the video_stream.py file.

Because the Intel RealSense 415 camera , video frame is 60 PFS.

so need to edit the video_stream.py

Solution:

if source_fps == 0 : source_fps = 60 #replace this number with your camera fps.

just above

trg_time_step = 1.0 / float(source_fps)

in Video_stream.py file

The program can Run and display video images now.

But have another new ASL demo error need to solved.

The Demo Windows only able shows user tracking, but not do any ASL hand signs detection or readings.

Program can only do tracking user when walking around with square lines border and number '0'.

But program does not do any ASL hand sign recognition , nor reading ASL hand signs at all.

When user do any ASL sign , the program did not shows anything detections, and not shows any reading user's hands  ASL hand signs.

For reference: The command that I Run 

"python
asl_recognition_demo.py -m_a asl-recognition-0004.xml -m_d
person-detection-asl-0001.xml -i 1 -c classes.json"

at 

C:\Program Files (x86)\IntelSWTools\openvino_2021.1.110\deployment_tools\open_model_zoo\demos\python_demos\asl_recognition_demo\

Have moved all the .xml and bin files in same directory

both asl-recognition-0004 and person-detection-asl-0001

ASL Demo program error:

Demo Windows program Run, and show video images, program able to tracking user,  but program has not do any ASL hand signs detection , program not do any reading user's hand signs.

Anyone know how to enable the ASL detection and Reading?

or where might be the problem need to be corrected?

[Iffa_Intel]

Hi,

It is recommended for you to try the new OpenVINO 2021.2 release where asl_recognition_demo was replaced with gesture_recognition_demo as in this guide: - https://docs.openvinotoolkit.org/latest/omz_demos_python_demos_asl_recognition_demo_README.html

Sincerely,

Iffa

[Iffa_Intel]

Greetings,

Intel will no longer monitor this thread since we have provided a solution. If you need any additional information from Intel, please submit a new question. 

Sincerely,

Iffa