topic Re: Re:Are there any ways that can control prefetcher flexibly? in Mobile and Desktop Processors

Are there any ways that can control prefetcher flexibly?

oleotiger — Mon, 26 Apr 2021 12:30:30 GMT

I'm working with Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz.

There are some knobs that can control the prefetcher behavior in BIOS control panel. The prefetchers can be controlled with register written as well.

But the way to control prefetchers is only switching on/off.

Prefetching stragedy can be determined flexibly with two variables: prefetching distance and degree. For prefetching algorithm in intel cpu, the algorithm may be more complicated. But I think there are still some paremeters which determines whether to prefetch aggresively or passively.

Can someone provide some ways, such as register written, that can control prefetching behavior flexibly on intel 6248R CPU instead of switching on/off?

Re:Are there any ways that can control prefetcher flexibly?

DeividA_Intel — Tue, 27 Apr 2021 17:12:39 GMT

Hello oleotiger,

Thank you for posting on the Intel® communities.

We would like to inform you that we have a forum for these specific issues and products, so we are moving it to the appropriate forum so you can get better support for this matter.

Regards,

Deivid A.

Intel Customer Support Technician

Re:Are there any ways that can control prefetcher flexibly?

IntelSupport — Tue, 27 Apr 2021 20:28:31 GMT

Hello oleotiger,

Thank you for posting in the Intel Community.

We understand that you are looking for ways to control the prefetcher flexibly of the Intel® Xeon®, to have more details about your environment and project please let us know the following details:

What is the model of the server/workstation that you are using with the Intel® Xeon®?
Are you having any issues with the system?
Do you have any particular purpose or project that requires you to modify the prefetcher flexibly?
Are you working on system development?

Regards,

Leonardo C.

Intel Customer Support Technician

Re: Re:Are there any ways that can control prefetcher flexibly?

oleotiger — Wed, 28 Apr 2021 02:08:11 GMT

There are 8 servers as a cluster with the Intel® Xeon® to run HPC application, such as WRF with both intelmpi and openmpi.
There is no issue with the system.
Yes. With vtune, I found that there is high L3 miss rate (about 70%~80%). In the meanwhile, the application is typically memory bound and memory bandwidth is the bottleneck I think.As inefficient prefetching can introduce much overhead to the memory bandwidth and reduce the performance. I wanna to try if adjusting the prefetching policy could improve the performance.I would like to try both aggressive-->passive policy and different prefetching algorithm (According to HPC application, there are many indirectly memory access pattern e.g. a[b[c]] and the prefetching pattern is much different from common applications.).In conclusion, I want to find a suited prefetching algorithm and appropriate policy(not too passive nor too aggressive) to improve the performance of HPC application. But I didn't find a way to control it flexibly?BTW : I tried turning on/off various prefetcher of SoC(e.g. hardware prefetcher, steame prefetcher), keeping perfetcher on achieves better result.
No, I'm working on performance tuning.

Re:Are there any ways that can control prefetcher flexibly?

IntelSupport — Wed, 28 Apr 2021 13:53:51 GMT

Hello oleotiger,

Thank you for the details about your interest in this matter. Let us look into this question; we are going to reach you back as soon as possible.

Regards,

Leonardo C.

Intel Customer Support Technician

Re:Are there any ways that can control prefetcher flexibly?

IntelSupport — Mon, 03 May 2021 17:16:33 GMT

Hello oleotiger,

Thank you for waiting.

We would like to inform you that the prefetching setting as you have found can be switch on/off; it doesn't have a set of controls to increase/decrease prefetching distance or aggressiveness.

Thank you for your feedback about the prefetching setting/performance.

Regards,

Leonardo C.

Intel Customer Support Technician

Re:Are there any ways that can control prefetcher flexibly?

IntelSupport — Wed, 05 May 2021 20:29:32 GMT

Hello oleotiger,

I am checking on your thread to know if you need further assistance with this request.

Regards,

Leonardo C.

Intel Customer Support Technician

Re: Re:Are there any ways that can control prefetcher flexibly?

oleotiger — Thu, 06 May 2021 03:13:16 GMT

It's really a pity that I cannot control prefetchers flexibly.

If there is much inefficient prefetching ( there must be a certain percentage of prefetching that is efficient), it results in overhead in memory bandwidth. I think just turning prefetchers on or off both can not achieve the best performance.

I believe there must be a tradeoff that we can get memory bandwidth overhead and prefetching efficiency balanced.

Does intel do it automically? How could users get involed with the prefetching policy?

Re:Are there any ways that can control prefetcher flexibly?

IntelSupport — Thu, 06 May 2021 14:33:35 GMT

Hello oleotiger,

Thank you for your response. let us look into your request; we will be posting back as soon as possible

Regards,

Leonardo C.

Intel Customer Support Technician

Re:Are there any ways that can control prefetcher flexibly?

IntelSupport — Mon, 10 May 2021 15:32:11 GMT

Hello oleotiger,

We would like to share with your that we are still working on your request. We are going to update this question as soon as we have any updates.

Regards,

Leonardo C.

Intel Customer Support Technician

Re:Are there any ways that can control prefetcher flexibly?

IntelSupport — Wed, 12 May 2021 12:26:24 GMT

Hello oleotiger,

Thank you for waiting.

As mentioned earlier there aren't options to control prefetcher flexibly. In reference to the memory bandwidth performance we have the following questions:

Are you using a 2-socket or 4-socket platform?
Did you see better memory bandwidth performance with older Xeon processors such as Haswell or Broadwell?
Does your application use non-temporal writes (NTWs)? If so, depending on the version of the software being used, there are some updates to glibc in version 2.17 & 2.18 or later.
The server's BIOS may have exposed some BIOS options that can influence cache traffic and latencies. We suggest checking your BIOS for the following options:
- Snoop Mode
- LLC (last level cache) Prefetch
- Dead Line LLC allocation (or LLC deadline alloc)
- Directory AtoS (or Stale AtoS)
- DBP-for-F

Regards,

Leonardo C.

Intel Customer Support Technician

Re: Re:Are there any ways that can control prefetcher flexibly?

oleotiger — Mon, 17 May 2021 00:57:41 GMT

Are you using a 2-socket or 4-socket platform?
- 2-Socket Platform

Did you see better memory bandwidth performance with older Xeon processors such as Haswell or Broadwell?
- I don't have processors such as Haswell or Broadwell . So I can't give you the conclusion.
Does your application use non-temporal writes (NTWs)? If so, depending on the version of the software being used, there are some updates to glibc in version 2.17 & 2.18 or later.
- No, I think the latest glibc won't help in performance.
The server's BIOS may have exposed some BIOS options that can influence cache traffic and latencies. We suggest checking your BIOS for the following options:
- Snoop Mode
- LLC (last level cache) Prefetch
- Dead Line LLC allocation (or LLC deadline alloc)
- Directory AtoS (or Stale AtoS)
- DBP-for-F

This may help. I will try these knobs in BIOS.

Re:Are there any ways that can control prefetcher flexibly?

IntelSupport — Mon, 17 May 2021 15:33:47 GMT

Hello oleotiger,

Thank you for your response. please let us know the outcome of the testing in the BIOS setting.

Regards,

Leonardo C.

Intel Customer Support Technician

Re:Are there any ways that can control prefetcher flexibly?

IntelSupport — Wed, 19 May 2021 19:54:55 GMT

Hello oleotiger,

I am checking on your thread to know if you need further assistance with this request.

Regards,

Leonardo C.

Intel Customer Support Technician

Re:Are there any ways that can control prefetcher flexibly?

IntelSupport — Mon, 24 May 2021 19:40:28 GMT

Hello oleotiger

We have not heard back from you, so we will close this inquiry. If you need further assistance, please post a new question.

Regards,

Leonardo C.

Intel Customer Support Technician