Processors
Intel® Processors, Tools, and Utilities
14395 Discussions

Xeon 2nd Gen Processor shows lower performance in Speed comapared with 1st Xeon Gen CPU

LVCSR
Beginner
888 Views

Hello,

I am a engine developer for automatic speech recognition (ASR) using KALDI framework.

I got a speed latency in processing the speech recognition after I changed CPU

from "Intel(R) Xeon(R) CPU E5-2640 v4 @ 2.40GHz"

to "Intel(R) Xeon(R) Silver 4215 CPU @ 2.50GHz".

 

Intel Product Documents describes they are operated in different method (sky-lake vs cascade-lake) although their clock speeds are different about 0.1 GHz.

 

After I chcked their elapsed time in my each functions, the most largest time difference are in below:

kaldi/src/nnet3/nnet-compute.cc:237 (referenced from https://kaldi-asr.org/)

LVCSR_1-1643445631508.png

which is propagation part with a neural network model for acoustic model including layers such as TDNN / LSTM / GRU / CNN / ATTENTION.

LVCSR_2-1643445796610.png

 

And here is my compile option flags in g++ (I use a Intel MKL):

 

-msse -msse2 -mssse3 -msse4.2 -mavx -mavx2 -mavx512vnni -m64  -march=x86-64 -march=cascadelake -DHAVE_MKL -O3

 

Is there any missing flags for 2nd GEN Xeon Cascade-lake CPU acceleration?

OR, is there other settings for 2nd GEN Xeon CPU? (Main-Board Setting, Neural Network Structure, Math Library, etc. )

 

0 Kudos
8 Replies
JoseH_Intel
Moderator
865 Views

Hello LVCSR,


Thank you for joining the Intel community


Just with an initial look in ark.intel.com Intel® Product Specification Comparison we can see the Xeon(R) CPU E5-2640 v4 @ 2.40GHz could be a faster processor based on it characteristics. It has a higher cache (25 Mb) and higher max memory size and the clock speed difference is not significant.


Been said that could you share the system details (board model, current firmware, total RAM, OS) based on this we will be able to try to replicate the issue and engage our engineering team.


We will look forward to your updates.


Regards


Jose A.

Intel Customer Support Technician

For firmware updates and troubleshooting tips, visit:

https://intel.com/support/serverbios


0 Kudos
JoseH_Intel
Moderator
856 Views

Hello LVCSR,


I am just following up to double check if you were able to gather the requested information. Otherwise let us know if you require more time to accomplish this. I will try to reach you back on next Monday 7th. After that the thread will be automatically archived.


Regards


Jose A.

Intel Customer Support Technician

For firmware updates and troubleshooting tips, visit:

https://intel.com/support/serverbios


0 Kudos
LVCSR
Beginner
853 Views

Hello, Jose!
Thank you for your replies for my post and sorry to delayed reply.

 

Your requested information is attached using command "lshw -short"

 

main board & firmware

LVCSR_0-1643868110206.png

 

total RAM : 128GB

OS : CentOS Linux release 7.8.2003 (Core)

 

One critical thing I just checked is "Sky Lake-E PCU Registers" in lshw results.

Is their mainboard-related comapatibility of cascade lake CPUs? 

 

I really really appreciate for your support and replies.

 

Sincerely,

LVCSR.

0 Kudos
JoseH_Intel
Moderator
840 Views

Hello LVCSR,


Thank you very much for the information attached. One think that I did not quite understant is this question?

Is their mainboard-related compatibility of cascade lake CPUs? 

And actually take me to my next comment about you are using a Supermicro board so the best option to get compatibility information would be with them directly.

And for the same reason we won't be able to perform any issue replication as per we only have Intel boards and CPUs available for this purposes, so once again it will be better to contact Supermicro


Regards


Jose A.

Intel Customer Support Technician

For firmware updates and troubleshooting tips, visit:

https://intel.com/support/serverbios


LVCSR
Beginner
818 Views

Hello Jose,


I checked Supermicro BIOS version is 1.10A (latest version : 3.5).

 

Furthermore, there is a description in Supermicro update notes that is relevant with Xeon CPU device generations such as Sky-Lake, Cascade-Lake, and Ice-Lake.

After updating BIOS version to upper version, I will check the speed and reply as soon as possible.

 

Thank you for your benevolent replies.

 

 

Sincerly,

LVCSR

0 Kudos
JoseH_Intel
Moderator
816 Views

Hello LVCSR,


Thank you for your updates. We will wait for the outcome after updating the board BIOS firmware.


Regards


Jose A.

Intel Customer Support Technician

For firmware updates and troubleshooting tips, visit:

https://intel.com/support/serverbios


0 Kudos
JoseH_Intel
Moderator
801 Views

Hello LVCSR,


I am just following up to double check if you were able to do some progress after updating the board BIOS. If not completed yet let us know if you require more time to accomplish this. i will try to reach you back on next Tuesday 15th. After that the thread will be automatically archived.


Regards


Jose A.

Intel Customer Support Technician

For firmware updates and troubleshooting tips, visit:

https://intel.com/support/serverbios


0 Kudos
JoseH_Intel
Moderator
788 Views

Hello LVCSR,


We will proceed to mark this thread as closed. If you have further issues or questions just go ahead and submit a new topic.


Regards


Jose A.

Intel Customer Support Technician

For firmware updates and troubleshooting tips, visit:

https://intel.com/support/serverbios


0 Kudos
Reply