New cpu feature idea: a flag to check prefetched data in L1 cache

[jowoma]

This idea could significantly boost performance and efficiency in data processing for future Intel CPUs. Please forward it to the Intel CPU designers for consideration. 

The hardware for this might already exist but isn't exposed to programmers.

The Idea:

Add a CPU flag or instruction that lets software check if prefetched data has arrived in the L1 cache.

Alternatively, introduce a conditional move instruction that loads data from a memory address into a register if the data is present in the L1 cache, or continues without stalling if the data isn't there yet.

Why It Matters:

• Avoid Pipeline Stalling: Functions can perform other useful work while waiting for the data, minimizing idle time and maximizing CPU utilization.
• Dynamic Data Access: Functions with loops that read memoized data can start with a slower method and switch to reading from the L1 cache once the data arrives, making processing much faster and more responsive.

How It Could Work:

• Add a new instruction or flag to the ISA that lets software query the cache status of a specific address, or keep a status flag for each prefetch instruction executed. This flag would indicate whether the data has been successfully prefetched into the L1 cache or if it is still in process.
• Introduce a conditional move instruction that loads data into a register if it is present in the L1 cache, or continues execution without stalling if the data is not yet available.

Make it lightweight and efficient to avoid performance penalties.

[JeanetteC_Intel]

Hello jowoma,

Thank you for sharing your idea with us. We appreciate your input and the time you took to provide us with your suggestion. I will submit your idea to our team for further evaluation. Our Business Unit (BU) will assess its validity and potential implementation. Please be advised that while we value your contribution, we cannot make any promises at this stage regarding whether your idea will be taken into consideration or implemented. Rest assured that it will be reviewed by the appropriate team.

Thank you once again for your valuable feedback. I will now close this case as it has been transferred to the relevant Intel group for further evaluation.

Should you need assistance in the future, please submit a new question as this thread will no longer be monitored.

Sincerely,

JeanetteC.

Intel Customer Support Technician