GPU Compute Software
Ask questions about Intel® Graphics Compute software technologies, such as OpenCL* GPU driver and oneAPI Level Zero
Announcements
FPGA community forums and blogs on community.intel.com are migrating to the new Altera Community and are read-only. For urgent support needs during this transition, please visit the FPGA Design Resources page or contact an Altera Authorized Distributor.
370 Discussions

How to profiling Intel GPGPU memory usage for model inference? Is there any summaries?

Maki1
Beginner
‎10-28-2024 12:04 AM
919 Views

Our system information:

 

CPU: Intel Ultra 7 155H

OS: Ubuntu 22.04

 

We use vtune from oneapi to profile the memory usage during model infernence, we walk thoughtout entire vtune-GUI software but we didn't found where is a summary for memory usage, especially GP part (not rendering).

 

Is there any command like `nvidia-smi`, to directly show the memory consumption and core usage with a single command, or any tools just like Windows task manager. 

Labels (1)
Labels:
0 Kudos

Link Copied

1 Reply
Steve_rogers24
Beginner
‎11-15-2024 10:57 AM
704 Views

To monitor GPU memory and core usage on Ubuntu, you can use nvidia-smi for NVIDIA GPUs or intel_gpu_top for Intel GPUs. For a more comprehensive system overview, use System Monitor (gnome-system-monitor) or htop for CPU and memory usage. For an interactive NVIDIA GPU monitor, install nvtop. These tools provide real-time monitoring similar to Windows Task Manager.

0 Kudos
Copy link
Reply

Community support is provided Monday to Friday. Other contact methods are available here.

Intel does not verify all solutions, including but not limited to any file transfers that may appear in this community. Accordingly, Intel disclaims all express and implied warranties, including without limitation, the implied warranties of merchantability, fitness for a particular purpose, and non-infringement, as well as any warranty arising from course of performance, course of dealing, or usage in trade.

For more complete information about compiler optimizations, see our Optimization Notice.