Can't run AMX Instructions on Intel® Xeon 4th Gen ® Scalable processor

[pascalrb]

Hi everyone,

I got a hold of small VM from the Developer Cloud which has the latest Intel® Xeon 4th Gen ® Scalable processor. Based on this article (https://www.intel.com/content/www/us/en/developer/articles/technical/accelerate-pytorch-training-inference-on-amx.html#gs.67r2vh), the Intel® Xeon 4th Gen ® Scalable processor should be equipped with the AMX accelerator which has the new Tile Registers and supporting Tile Multiplication instructions.

However, I am not able to run the sample code from (https://www.intel.com/content/www/us/en/developer/articles/code-sample/advanced-matrix-extensions-intrinsics-functions.html#gs.67r3za) (https://github.com/intel/AMX-TMUL-Code-Samples/tree/main). I am getting an error which is indicative that the VM doesn't have AMX enable. I followed the first link to check if AMX intrinsics are available (lscpu | grep amx) but nothing comes up. I also manually updated the linux kernel to 5.18 which should meet the 5.17+ requirement.

How do I get access to the AMX instructions exactly? Do the VMs instances from (https://console.cloud.intel.com/hardware) not support the AMX instructions?

Below are my system's information:

Any help is appreciated.

[Hairul_Intel]

Hi pascalrb,

Thank you for reaching out to us.

You've mentioned that you were able to manually update the Kernel version to 5.18.

As such, I'd suggest for you to try updating to Kernel version 5.19 and see if running lscpu | grep amx will prompt out the correct flags.

If the issue still persists, do share the following details for further investigation:

Instance ID:

Reservations details:

Start time:

End time:

Regards,

Hairul

[pascalrb]

Thank you for the suggestion Hairul. Unfortunately, upgrading to Kernel version 5.19 didn't work:

As requested, below are the system's information:

Instance ID (didn't see exactly that but sharing Resource ID):

44a66b27-750a-49c0-9e49-76ff65b554a0

Reservations details:

Start time (Created at): 10/10/2023 1:53 pm

End time: (When credits run out)

I didn't find exactly the information you asked so I shared derivations of them.

Below is the complete information about the instance:

Please let me know if you need more information.

[Hairul_Intel]

Hi pascalrb,

Thank you for sharing the information.

We've escalated this issue to the relevant teams for further investigation and will update you as soon as possible.

Regards,

Hairul

[pascalrb]

Thank you Hairul.

[Hairul_Intel]

Hi pascalrb,

We just got feedback regarding this issue.

For your information, AMX instructions are not enabled in a Virtual Machine environment. You'll need to reserve a Bare Metal instance in order to use AMX instructions.

Hope this helps.

Regards,

Hairul

[Hairul_Intel]

Hi pascalrb,

This thread will no longer be monitored since we have provided information. If you need any additional information from Intel, please submit a new question.

Regards,

Hairul

[pascalrb]

Hi Hairul,

Thank you for the information.

Regards,

Pascal