How to complute FLOPS of Xeon CPUs?

[oleotiger1]

I found on documents that

• 4th Gen Intel Xeon Processor can achieve 1024 operations per cycle per core on BF16 and 2048 on INT8  with AMX.
• 3th Gen Intel Xeon can achieve 64 operations per cycle per core on FP32 and 256 on INT8 with AVX-512 VNNI.

How can we get the number of FLOPS? What may I take it wrong?

For 3rd Gen cores, each core achieves 512(bitwidth)/32(FP32)*2(2 avx unit per core)=32 !=64

For AMX, each core achieves 1024(bitwidth)/16(BF32)**2(tile square)=4096 !=1024

And why FLOPS@INT8 != 4*FLOPS@BF16?

[RamyerM_Intel]

Hello oleotiger1, 

I noticed your question is about Intel Xeon Processor. I want to let you know that we have a dedicated forum for this type of issue, where you can get faster answers. I am moving this to the Server Forum for you.

Ramyer M. 

Intel Customer Support Technician 

[Azeem_Intel]

Hi oleotiger1,

Greeting for the day!

I hope you are doing well, Could you please share the product specification details? This will help us identify which product you have. Additionally, if possible, could you provide pictures related to the issue? This will allow us to better understand and assist you,

Please do not hesitate in contact us, we are more than glad to assist you.

Best Regards,

Azeem_Intel

[oleotiger1]

Related information：https://phoenixnap.com/kb/intel-amx-advanced-matrix-extensions

I'm considering Intel Xeon 8480+ CPU

[IntelSupport]

Hi oleotiger1

Greeting for the Day!

I hope this message finds you well. I wanted to provide you with an update regarding the recent developments in computing technology, particularly concerning Floating Point Operations Per Second (FLOPS).

Please be informed that Intel no longer makes FLOPS (Floating Point Operations) per cycle information available for Intel® processors.

Kindly go through this link for reference.

Where Can I Find Information about FLOPS Per Cycle for Intel®...

Thank you for your patience and understanding.

Regards,

Manoranjan Das

[Azeem_Intel]

Hello oleotiger1,

Hope you are doing well

We are following up to find out if you were able to find the information we provided. Please reply to confirm, so we can continue helping on a resolution. Looking forward to receiving your reply.

Please do not hesitate in contact us, we are more than glad to assist you.

Best Regards,

Azeem_Intel

[Azeem_Intel]

Hello oleotiger1,

Hope you are doing well

We are following up to find out if you were able to find the information we provided. Please reply to confirm, so we can continue helping on a resolution. Looking forward to receiving your reply.

Please do not hesitate in contact us, we are more than glad to assist you.

Best Regards,

Azeem_Intel

[oleotiger1]

“Kindly go through this link for reference.”

I didn't find the link...

[Azeem_Intel]

Hello oleotiger1,

Hope you are doing well

Thank you for your response, Kindly find the link below.

https://www.intel.com/content/www/us/en/support/articles/000096700/graphics.html#:~:text=Information%20about%20FLOPS%20Per%20Cycle%20is%20found%20in%20online%20manuals,GPU%20Optimization%20Guide%2C%20and%20Wikipedia.&text=Need%20Peak%20Tensor%20throughput%20performance,FP32%20FLOPS

Please do not hesitate in contact us, we are more than glad to assist you.

Best Regards,

Azeem_Intel

[Azeem_Intel]

Hello oleotiger1,

Hope you are doing well

We are following up to find out if you were able to find the information we provided. Please reply to confirm, so we can continue helping on a resolution. Looking forward to receiving your reply.

Please do not hesitate in contact us, we are more than glad to assist you.

Best Regards,

Azeem_Intel

[Azeem_Intel]

Hello oleotiger1,

Hope you are doing well

This is the second follow-up regarding the reported issue. We're eager to ensure a swift resolution and would appreciate any updates or additional information you can provide.

Please feel free to respond to this email at your earliest convenience.

Best Regards,

Azeem_Intel

[Azeem_Intel]

Hello oleotiger1,

Hope you are doing well

This is the third follow-up regarding the reported issue. We're committed to ensuring a swift resolution and would greatly appreciate any updates or additional information you can provide.

If we don't hear back from you soon, we'll assume the issue has been resolved and will proceed to close the case.

Please feel free to respond to this email at your earliest convenience.

Best Regards,

Azeem_Intel

[oleotiger1]

Thanks for your help. This  issue can be closed now.