I have an Iris Plus Graphics 655 GPU (Gen 9.5) with DPC++ code that runs a kernel with a parallel_for and that create an array on the stack (ex. uint32_t array).
Is this allocation automatically put on the L1 Cache of the Execution Unit (EU)?
I can't understand this from vtune
Thanks for posting in Intel Communities.
>>"I can't understand this from vtune"
Could you please provide the results of the VTune profiler?
Could you please let us know which device selector (CPU/GPU/default)you are using?
Thanks & Regards,
I'm using the default selector and the GPU is correctly selected
Attached VTune results and a demo I prepared to expose the problem, compiled with
dpcpp -std=c++17 -fsycl -O2 -g HelloOneApi.cpp
I was expecting to see the local array promoted to registers and this reflected someway in the profiler, but I can't understand this from the VTune report. If I use a bigger local array size I was expecting L1 (Sampler cache) to be used, but can't see this too.
I had to run VTune from Ubuntu because is not working on Windows:
- Always interrupt the collection before the end of the application and tell me that the collected file is corrupted (see attached screenshoot)
- I can't fully install the sampling driver on Windows 10 too (see attached screenshoot)
Here is the response from our team:
The per work-item array will be tried in GRF (general-purpose register file) and will spill onto global memory if too big on Gen9, because L1 cache is read-only on Gen9 and ATS.
The array referred is the private for each work item. If so, private memory in SYCL is typically mapped to hardware registers if the size fits. I believe each EU has 7 threads for a total of 28KB of general purpose register in Gen9 based Intel GPU (see figure 3 on page 6, https://www.intel.com/content/dam/develop/external/us/en/documents/the-compute-architecture-of-intel...). The situation will depend on the number of work items as well as the array size. I would expect caching register spill is reasonable when that is necessary, as SYCL runtime will always aim to allocate memory in the most optimal way.
To debug the Windows data collection driver issues, please see https://www.intel.com/content/www/us/en/develop/documentation/vtune-help/top/set-up-analysis-target/...
Note: you must run VTune Profiler as Administrator for most of the data collection analysis types.