Artificial Intelligence (AI)
Discuss current events in AI and technological innovations with Intel® employees
490 Discussions

Intel® Neural Compute Stick 2: Smarter, Faster, Plug-and-Play AI at the Edge

MaryT_Intel
Employee
0 0 1,770
Based on the Intel® Movidius™ Myriad™ X vision processing unit (VPU), Intel NCS 2 boosts performance up to 8x1 over the last generation for running deep neural networks.

Introducing the New Intel® Neural Compute Stick 2 – Intel’s next generation AI inference development kit.

From identifying the rarest animal species to counting millions of product SKUs on grocery store shelves, computer vision applications span a wide variety of innovative use cases. These network edge devices require form factors that meet the needs of space and power-constraints while speeding solution development with integrated stacks of hardware and software.

The Intel® Neural Compute Stick 2 (Intel® NCS 2), which was introduced today at Intel AI Devcon in Beijing, is purpose built for computer vision and AI inference applications, making it faster and easier to develop products for the network edge. Based on the Intel® Movidius™ Myriad™ X vision processing unit (VPU), Intel NCS 2 boosts performance up to 8x1 over the previous generation for running deep neural networks. Combining it with the Intel® Distribution of OpenVINO™ toolkit gives you an optimized development kit for computer vision and AI.

Intel® NCS 2: The Next-Generation Inference Accelerator

When you’re developing AI solutions, you want to be able to start projects at low cost and see where they go. For the ones that look promising, it’s important that the solution can scale and transition directly to whatever production hardware you need. With its unique approach to solving the performance and power challenges inherent in embedded architecture and sparse data structure, the Intel NCS 2 is an affordable, convenient approach for prototyping that can later be ported to scale production.

Using a USB 3.0 form factor for ubiquitous connectivity, the Intel NCS 2 helps you get AI inference and computer vision applications up and running quickly. For example, after being developed, tuned, and tested on a laptop for, DNNs can be deployed to any prototype endpoint device with a USB port, to support on-device inference independent of cloud or other connectivity.

Then when solutions reach perfection, the Intel® AI: In Production ecosystem partners allows you to rapidly deploy your prototype to a variety of embedded form factors such as mini-PCIe or M.2 cards based on the Intel Movidius Myriad X VPU. All this, without having to change or modify your code thanks to the Intel Distribution of OpenVINO toolkit and its “write once, deploy everywhere” approach.

182_image_2.jpg

Next-Gen VPU: A More Powerful “Brain” Inside

The heart of Intel NCS 2 is the Intel Movidius Myriad X VPU, the new generation of low-power AI inference processor designed specifically for running deep neural networks (DNNs) at high performance. It features the Neural Compute Engine, a dedicated built-in hardware-based accelerator for DNN inferences.

The array of 16 programmable SHAVE (Streaming Hybrid Architecture Vector Engine) cores represents an increase of 33 percent over the last generation, supported by an ultra-high throughput intelligent memory fabric.

Optimized Toolkit: A Shot in the Arm for Efficiency

The Intel® Distribution of OpenVINO™ toolkit makes it faster and easier to build software that emulates human vision. Libraries of pre-trained models, optimized computer vision algorithms, and sample code save you from having to build solution underpinnings from scratch. That lets you focus on secret sauce instead of scaffolding.

The toolkit is also the key for enabling “write once, deploy everywhere” development with the Intel NCS 2. A common API makes workloads at home on all kinds of computer vision platforms and accelerators from Intel, including CPUs, Integrated Graphics, FPGAs and the VPU inside Intel NSC 2.

Take the Next Step

The Intel NCS 2 is here to usher in a new generation of smarter devices. So bring your smart cameras, robots, and drones. Bring your innovative ideas. And bring them all to life.

Get started at intel.com/ncs

About the Author
Mary is the Community Manager for this site. She likes to bike, and do college and career coaching for high school students in her spare time.