Analyzers
Talk to fellow users of Intel Analyzer tools (Intel VTune™ Profiler, Intel Advisor)
4975 Discussions

L1 hit ratio vs. Prefetching

Ambuj_P_
Beginner
662 Views

My hotspot function in VTune shows that L1 hit ratio is 99% (and L1 misses is 5%). Does that mean that almost all of the data I need is already prefetched into the caches and there is no need for manual prefetching?

0 Kudos
5 Replies
Bernard
Valued Contributor I
662 Views

Probably data is aligned and is accessed in linear pattern.For example a small array of 512 doubles.Moreover such loop If I am not wrong when translated to <= 28 uops could be a candidate for LSD.

0 Kudos
David_A_Intel1
Employee
662 Views

Yes, and you should really focus on the L2 cache.  The penalty for missing L1 is very small.  However, if the CPU has to go to L2 and the data is NOT there, then you incur a huge penalty (10x to 20x the L1 penalty) and this is what you want to tune (unless you are on a server chip with L3...).  Note: that doesn't mean you have to use manual prefetching!  The processor is very good at prefetching by itself and if you start adding prefetching by hand, you could actually reduce your performance.  Instead, focus on data layout and getting all the data you need to touch in the same cache line (e.g., members of a struct, touch them all, don't use multiple loops and touch one member in each loop).

0 Kudos
Bernard
Valued Contributor I
662 Views

Preferred layout for your data can be SoA (Structure of Arrays).Of course it depends on what physical phenomenon your code is modeling.For example particle simulation.

0 Kudos
Ambuj_P_
Beginner
662 Views

@MrAnderson 

Yes, penalty for an L2 miss is indeed quite high, but doesn't L1 hit ratio being 99% mean that 99% of my data needs are properly prefetched and only 1% is missed, so even if this 1% is missed in L2 as well, its still a trivial number? I'm using it on MIC.

0 Kudos
David_A_Intel1
Employee
662 Views

Ah, yes.  Sorry.  I misread your original post.  Your understanding is correct.

0 Kudos
Reply