OpenVINO and SYCL compatibility issues

[yaoy]

I am working on a project that requires the use of both SYCL for computations running on GPU and OpenVINO for model inference on NPU. However, I'm encountering a compatibility issue between the two.

Please refer to the following example code that reproduces the issue. If OpenVINO runtime is initialized first, an exception is triggered when creating a SYCL queue. Conversely, if the queue is created first, OpenVINO fails to detect the NPU device.

Please let me know if it is expected that OpenVINO is incompatible with SYCL, or if there is anything I need to do for them to work together. Thanks a lot!

My device, driver, and platform specifications are as follows.

Processor:       Intel(R) Core(TM) Ultra 9 185H   3.40 GHz

System type:  64-bit operating system, x64-based processor

Windows specifications:

    Edition:            Windows 11 Enterprise

    Version:           21H2

    OS build:         22000.3079

    Experience:     Windows Feature Experience Pack 1000.22004.1000.0

Visual Studio Enterprise 2022 (64-bit):

    Version: 17.10.5 

    Compiler: Intel(R) oneAPI DPC++ Compiler 2024.2.0 (2024.2.0.20240602)

OpenVINO Runtime:

    Version : 2024.2.0

    Build   : 2024.2.0-15519-5c0f38f83f6-releases/2024/2

SYCL Platform Information:

    Name: Intel(R) Level-Zero

    Vendor: Intel(R) Corporation

    Version: 1.3

GPU Device Information:

    Name: Intel(R) Arc(TM) Graphics

    Vendor: Intel(R) Corporation

    Driver Version: 32.0.101.5768

NPU Device Information:

    Name: Intel(R) AI Boost

    Driver version: 31.0.100.1688

[Iffa_Intel]

Hi,

Have you tried to put on some delay to ensure one process is finished before executing another?.

The most efficient way to do this is actually by implementing multithreading.

Cordially,

Iffa

[yaoy]

Hi Iffa,

Yes, I have tried using multithreading where one thread creates SYCL queue and another thread uses OpenVINO, in order to isolate their impacts to each other. I have made sure that one is finished before executing another, but unfortunately this does not resolve the issue. I still see them impacting each other the same way as when no multithreading is used.

Best,

Yao

[Iffa_Intel]

If the issue persists even before implementing SYCL, perhaps it's related to the OpenVINO installation itself.

Could you clarify:

1. Did you manage to run OpenVINO on your system without any issues before implementing any other additional functions? (perhaps try to run one of the OpenVINO Sample Application)
2. Have you consider of using OpenVINO Threading Utilities ?.

Cordially,

Iffa

[Iffa_Intel]

Hi,

Thank you for your question. If you need any additional information from Intel, please submit a new question as Intel is no longer monitoring this thread. 

Cordially,

Iffa