https://community.intel.com/t5/GPU-Compute-Software/How-to-profiling-Intel-GPGPU-memory-usage-for-model-inference-Is/m-p/1639631#M1624 <P>Our system information:</P><P>&nbsp;</P><P>CPU: Intel Ultra 7 155H</P><P>OS: Ubuntu 22.04</P><P>&nbsp;</P><P>We use vtune from oneapi to profile the memory usage during model infernence, we walk thoughtout entire vtune-GUI software but we didn't found where is a summary for memory usage, especially GP part (not rendering).</P><P>&nbsp;</P><P>Is there any command like `nvidia-smi`, to directly show the memory consumption and core usage with a single command, or any tools just like Windows task manager.&nbsp;</P> Mon, 28 Oct 2024 07:04:07 GMT Maki1 2024-10-28T07:04:07Z https://community.intel.com/t5/GPU-Compute-Software/How-to-profiling-Intel-GPGPU-memory-usage-for-model-inference-Is/m-p/1639631#M1624 <P>Our system information:</P><P>&nbsp;</P><P>CPU: Intel Ultra 7 155H</P><P>OS: Ubuntu 22.04</P><P>&nbsp;</P><P>We use vtune from oneapi to profile the memory usage during model infernence, we walk thoughtout entire vtune-GUI software but we didn't found where is a summary for memory usage, especially GP part (not rendering).</P><P>&nbsp;</P><P>Is there any command like `nvidia-smi`, to directly show the memory consumption and core usage with a single command, or any tools just like Windows task manager.&nbsp;</P> Mon, 28 Oct 2024 07:04:07 GMT https://community.intel.com/t5/GPU-Compute-Software/How-to-profiling-Intel-GPGPU-memory-usage-for-model-inference-Is/m-p/1639631#M1624 Maki1 2024-10-28T07:04:07Z https://community.intel.com/t5/GPU-Compute-Software/How-to-profiling-Intel-GPGPU-memory-usage-for-model-inference-Is/m-p/1643524#M1646 <DIV class=""><DIV class=""><DIV class=""><DIV class=""><P>To monitor GPU memory and core usage on Ubuntu, you can use nvidia-smi for NVIDIA GPUs or intel_gpu_top for Intel GPUs. For a more comprehensive system overview, use <A href="https://www.youcineapkpremium.com/" target="_self"><STRONG>System Monitor</STRONG></A> (gnome-system-monitor) or <STRONG>htop</STRONG> for CPU and memory usage. For an interactive NVIDIA GPU monitor, install <STRONG>nvtop</STRONG>. These tools provide real-time monitoring similar to Windows Task Manager.</P></DIV></DIV></DIV></DIV> Fri, 15 Nov 2024 18:57:24 GMT https://community.intel.com/t5/GPU-Compute-Software/How-to-profiling-Intel-GPGPU-memory-usage-for-model-inference-Is/m-p/1643524#M1646 Steve_rogers24 2024-11-15T18:57:24Z