Intel® Distribution of OpenVINO™ Toolkit
Community assistance about the Intel® Distribution of OpenVINO™ toolkit, OpenCV, and all aspects of computer vision-related on Intel® platforms.

OpenVINO and SYCL compatibility issues

yaoy
Employee
709 Views

I am working on a project that requires the use of both SYCL for computations running on GPU and OpenVINO for model inference on NPU. However, I'm encountering a compatibility issue between the two.

 

Please refer to the following example code that reproduces the issue. If OpenVINO runtime is initialized first, an exception is triggered when creating a SYCL queue. Conversely, if the queue is created first, OpenVINO fails to detect the NPU device.

Issue1.pngIssue2.png

Please let me know if it is expected that OpenVINO is incompatible with SYCL, or if there is anything I need to do for them to work together. Thanks a lot!

 

My device, driver, and platform specifications are as follows.

 

Processor:       Intel(R) Core(TM) Ultra 9 185H   3.40 GHz

System type:  64-bit operating system, x64-based processor

Windows specifications:

    Edition:            Windows 11 Enterprise

    Version:           21H2

    OS build:         22000.3079

    Experience:     Windows Feature Experience Pack 1000.22004.1000.0

 

Visual Studio Enterprise 2022 (64-bit):

    Version: 17.10.5 

    Compiler: Intel(R) oneAPI DPC++ Compiler 2024.2.0 (2024.2.0.20240602)

 

OpenVINO Runtime:

    Version : 2024.2.0

    Build   : 2024.2.0-15519-5c0f38f83f6-releases/2024/2

 

SYCL Platform Information:

    Name: Intel(R) Level-Zero

    Vendor: Intel(R) Corporation

    Version: 1.3

 

GPU Device Information:

    Name: Intel(R) Arc(TM) Graphics

    Vendor: Intel(R) Corporation

    Driver Version: 32.0.101.5768

 

NPU Device Information:

    Name: Intel(R) AI Boost

    Driver version: 31.0.100.1688

0 Kudos
4 Replies
Iffa_Intel
Moderator
601 Views

Hi,

 

Have you tried to put on some delay to ensure one process is finished before executing another?.

The most efficient way to do this is actually by implementing multithreading.

 

 

Cordially,

Iffa

0 Kudos
yaoy
Employee
591 Views

Hi Iffa,

 

Yes, I have tried using multithreading where one thread creates SYCL queue and another thread uses OpenVINO, in order to isolate their impacts to each other. I have made sure that one is finished before executing another, but unfortunately this does not resolve the issue. I still see them impacting each other the same way as when no multithreading is used.

 

Best,

Yao

0 Kudos
Iffa_Intel
Moderator
437 Views

 

If the issue persists even before implementing SYCL, perhaps it's related to the OpenVINO installation itself.

 

Could you clarify:

  1. Did you manage to run OpenVINO on your system without any issues before implementing any other additional functions? (perhaps try to run one of the OpenVINO Sample Application)
  2. Have you consider of using OpenVINO Threading Utilities ?.

 

 

Cordially,

Iffa

0 Kudos
Iffa_Intel
Moderator
334 Views

Hi,


Thank you for your question. If you need any additional information from Intel, please submit a new question as Intel is no longer monitoring this thread. 



Cordially,

Iffa


0 Kudos
Reply