When I was running Smart Classroom Demo with Neural Compute Stick 2, I noticed the fps result was lower than using CPU.
CPU model: Intel(R) Core(TM) i5-6200U CPU @ 2.30GHz 2.40 GHz
The results is attached as below:
This using Neural Compute Stick 2.
This using CPU.
Thank you for reaching out to us.
Intel® Neural Compute Stick 2 (NCS2) is a plug & play AI device for deep learning inference at the edge.
The performance of NCS 2 is generally lower than GPU and high-end CPUs. The results that you've obtained are within the expected range. Refer to Benchmark results for comparison of OpenVINO™ inferencing on different hardware.
Additionally, I ran the Smart Classroom C++ Demo using the same model on an Intel® Core™ i7-10610U CPU, on Windows 10, and I share my results here:
This thread will no longer be monitored since we have provided an explanation. If you need any additional information from Intel, please submit a new question.