How to profiling Intel GPGPU memory usage for model inference? Is there any summaries?

[Maki1]

Our system information:

CPU: Intel Ultra 7 155H

OS: Ubuntu 22.04

We use vtune from oneapi to profile the memory usage during model infernence, we walk thoughtout entire vtune-GUI software but we didn't found where is a summary for memory usage, especially GP part (not rendering).

Is there any command like `nvidia-smi`, to directly show the memory consumption and core usage with a single command, or any tools just like Windows task manager. 

[Steve_rogers24]

To monitor GPU memory and core usage on Ubuntu, you can use nvidia-smi for NVIDIA GPUs or intel_gpu_top for Intel GPUs. For a more comprehensive system overview, use System Monitor (gnome-system-monitor) or htop for CPU and memory usage. For an interactive NVIDIA GPU monitor, install nvtop. These tools provide real-time monitoring similar to Windows Task Manager.