Inference crash on CPU with Intel AMX

[msolmaz]

I am trying to do classification based on the sample code below on an AMX supported CPU.
https://github.com/openvinotoolkit/openvino/blob/master/samples/cpp/hello_classification/main.cpp

The model load and inference succeeds with my older PC (Intel i9-7940X, AVX2 and AVX512 supported) and I can see the output. But when I transfer and use the executable (and DLLs) on my new PC, the program hangs up and crashes in the following line:

infer_request.infer();

I can see the Exception code in Event Viewer as "0xc000001d", which some online search revealed as illegal instruction. As far as I know, AMX is supported using openvino_intel_cpu_plugin.dll. Why could this crash be happening?

OpenVINO Version: openvino 2023.0.2

Operating System: Windows 10 Enterprise [Version 10.0.19045.3086]

Device used for inference: 4th Gen Xeon CPU (w5-2465X)

IDE: Visual Studio 2017

[Megat_Intel]

Hi Msolmaz,

Thank you for reaching out to us.

We noticed that you have submitted a similar issue on our GitHub page. I will close this case now and we will continue to support your issue in the GitHub thread: https://github.com/openvinotoolkit/openvino/issues/21078

Regards,

Megat