For Nvidia GPUs there is a tool nvidia-smi that can show memory usage, GPU utilization and temperature of GPU. There also is a list of compute processes and few more options but my graphic card (GeForce 9600 GT) is not fully supported.

Sun May 13 20:02:49 2012       
+------------------------------------------------------+                       
| NVIDIA-SMI 3.295.40   Driver Version: 295.40         |                       
|-------------------------------+----------------------+----------------------+
| Nb.  Name                     | Bus Id        Disp.  | Volatile ECC SB / DB |
| Fan   Temp   Power Usage /Cap | Memory Usage         | GPU Util. Compute M. |
|===============================+======================+======================|
| 0.  GeForce 9600 GT           | 0000:01:00.0  N/A    |       N/A        N/A |
|   0%   51 C  N/A   N/A /  N/A |  90%  459MB /  511MB |  N/A      Default    |
|-------------------------------+----------------------+----------------------|
| Compute processes:                                               GPU Memory |
|  GPU  PID     Process name                                       Usage      |
|=============================================================================|
|  0.           Not Supported                                                 |
+-----------------------------------------------------------------------------+
Answer from pbm on Stack Exchange
🌐
Reddit
reddit.com › r/archlinux › check nvidia gpu usage
r/archlinux on Reddit: Check NVIDIA GPU Usage
December 29, 2020 -
[seedship@triple-destinies ~]$ nvidia-smi 
Tue Dec 29 22:31:07 2020       
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 455.45.01    Driver Version: 455.45.01    CUDA Version: 11.1     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  GeForce GTX 1070    Off  | 00000000:01:00.0  On |                  N/A |
| N/A   64C    P0    55W /  N/A |   1134MiB /  8116MiB |     79%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
                                                                               
+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|    0   N/A  N/A       770      G   /usr/lib/Xorg                     322MiB |
|    0   N/A  N/A    128937      G   /usr/lib/firefox/firefox            1MiB |
|    0   N/A  N/A    139902      G   ...mviewer/tv_bin/TeamViewer      207MiB |
|    0   N/A  N/A    147796      G   ...AAAAAAAA== --shared-files       26MiB |
|    0   N/A  N/A    148489      G   ...e/Steam/ubuntu12_32/steam       70MiB |
|    0   N/A  N/A    148504      G   ./steamwebhelper                    1MiB |
|    0   N/A  N/A    148516      G   ...token=1395340159186027037      434MiB |
|    0   N/A  N/A    149878      G   ...token=1571661428272191793       55MiB |
|    0   N/A  N/A    150371      G   /usr/lib/firefox/firefox            3MiB |
+-----------------------------------------------------------------------------+

I noticed high GPU usage on my GPU from nvidia-smi, but I saw that there are so many tasks utilizing GPU, I don't know who is causing it to be that high. I searched online for GPU profilers, but all I saw was nvidia-smi.

Does anyone know if there is a way to break down the % utilization of each task?

Discussions

A top-like utility for monitoring CUDA activity on a GPU - Stack Overflow
On linux, nVidia-smi 295.41 gives you just what you want. use nvidia-smi: [root@localhost release]# nvidia-smi Wed Sep 26 23:16:16 2012 +------------------------------------------------------+ | NVIDIA-SMI 3.295.41 Driver Version: 295.41 | |-------------------------------+----------------------+----------------------+ | Nb. Name | Bus Id Disp. | Volatile ECC SB / DB | | Fan Temp Power Usage /Cap | Memory Usage | GPU ... More on stackoverflow.com
🌐 stackoverflow.com
Monitor GPU usage with nvidia-smi
I tried to run tensorflow-gpu on Ubuntu 18.04 LTS with a Geforce 650 GPU. The installation process went just fine and it is possible to use tensorflow in my virtual environment. However I am not able to monitor the GPU usage with nvidia-smi command except for the overall temperature and memory ... More on forums.developer.nvidia.com
🌐 forums.developer.nvidia.com
5
0
September 27, 2018
Check NVIDIA GPU Usage
nvidia-smi pmon will print information about the GPU utilization by process continuously. More on reddit.com
🌐 r/archlinux
4
2
December 29, 2020
One small aspect where Linux is really lacking is GPU resource monitoring
🌐 r/linux
51
185
June 8, 2022
🌐
LinuxConfig
linuxconfig.org › home › monitoring nvidia gpu usage on ubuntu
Monitor NVIDIA GPU Usage on Ubuntu Effectively
March 21, 2024 - Monitor NVIDIA GPU usage on Ubuntu using nvidia-smi and nvtop. Learn to optimize GPU performance for gaming and professional tasks.
🌐
OneUptime
oneuptime.com › home › blog › how to monitor gpu usage with nvidia-smi on ubuntu
How to Monitor GPU Usage with nvidia-smi on Ubuntu
March 2, 2026 - By @nawazdhandala • Mar 02, 2026 • Reading time · Ubuntu NVIDIA Nvidia-smi GPU Monitoring Performance · nvidia-smi (NVIDIA System Management Interface) is the standard tool for monitoring and managing NVIDIA GPUs on Linux.
🌐
It's FOSS
itsfoss.com › gpu-usage-linux
Monitor GPU Usage on Ubuntu and Other Linux Systems
September 13, 2024 - So, you need to use a couple of specific programs or terminal tools that would let you access the usage data for your graphics card or integrated GPU. Here, I highlight the same after testing it on Ubuntu and Arch Linux. If you do not mind installing a GUI program for the job, Mission Center should be your preferred tool. It supports NVIDIA, AMD, and Intel GPUs.
🌐
nixCraft
cyberciti.biz › nixcraft › open source › command line hacks › top 7 linux gpu monitoring and diagnostic commands line tools
Linux GPU Monitoring and Diagnostic Commands Line Tools - nixCraft
February 3, 2025 - Run it as follows on Linux system: $ sudo intel_gpu_top · The nvidia-smi provides monitoring and management capabilities for each of NVIDIA’s Tesla, Quadro, GRID and GeForce devices from Fermi and higher architecture families. GeForce Titan series devices are supported for most functions with very limited information provided for the remainder of the Geforce brand.
Find elsewhere
🌐
NVIDIA Developer Forums
forums.developer.nvidia.com › graphics / linux › linux
Monitor GPU usage with nvidia-smi - Linux - NVIDIA Developer Forums
September 27, 2018 - I tried to run tensorflow-gpu on Ubuntu 18.04 LTS with a Geforce 650 GPU. The installation process went just fine and it is possible to use tensorflow in my virtual environment. However I am not able to monitor the GPU usage with nvidia-smi command except for the overall temperature and memory usage.
🌐
DigitalOcean
digitalocean.com › community › tutorials › monitoring-gpu-utilization-in-real-time
Monitor GPU Utilization in Real Time: A Complete Guide | DigitalOcean
April 6, 2026 - The fastest way to monitor GPU utilization in real time on Linux is to run nvidia-smi --loop=1, which refreshes GPU stats every second including core utilization, VRAM usage, temperature, and power draw.
🌐
LinuxVox
linuxvox.com › blog › check-gpu-usage-linux
Checking GPU Usage in Linux: A Comprehensive Guide — linuxvox.com
It is a good practice to regularly monitor GPU usage, especially in production environments. You can set up cron jobs to run monitoring commands at specific intervals and log the results for later analysis. For example, to run nvidia-smi every 15 minutes and save the output to a file:
🌐
UbuntuHandbook
ubuntuhandbook.org › home › howtos › how to monitor gpu usage in ubuntu 24.04 | 22.04
How to Monitor GPU Usage in Ubuntu 24.04 | 22.04 | UbuntuHandbook
They include intel-gpu-tools for Intel GPU, and nvtop for Intel, AMD, and NVIDIA. For the integrated Intel graphics card, there’s a command line tool intel_gpu_top can do the job. 1. First, press Ctrl+Alt+T on terminal to open a terminal window. When it opens, run command to install the package: ... Type user password when it asks (no asterisk feedback) and hit Enter. ... As you can see, it shows real-time IMC read and write speed, power usage, as well as percentage usage of 3D/Render, Blitter, Video, and VideoEnhance.
🌐
Baeldung
baeldung.com › home › administration › check and monitor active gpu in linux
Check and Monitor Active GPU in Linux | Baeldung on Linux
March 25, 2025 - Off | 0000:07:00.0 Off | N/A | | 25% 66C P2 72W / 250W | 8656MiB / 12207MiB | 0% Default | +-------------------------------+----------------------+----------------------+ +-----------------------------------------------------------------------------+ | Processes: GPU Memory | | GPU PID Type Process name Usage | |=============================================================================| | 1 666 G /usr/bin/X 587 MiB | | 0 667 C perl 11307 MiB | [...] +-----------------------------------------------------------------------------+ We see three NVIDIA cards with different amounts of memory usage on each.
🌐
LinuxBlog
linuxblog.io › home › best linux gpu monitor
Best Linux GPU Monitor | LinuxBlog.io
February 2, 2025 - GPUStat is for users who want a lightweight, simple way to keep an eye on their NVIDIA GPUs. The ncurses based interface gives you a quick snapshot of GPU usage, so it’s perfect for quick checks and troubleshooting without eating system resources.
🌐
Domsoria
domsoria.com › en › 2023 › 07 › analysis-management-and-monitoring-of-nvidia-gpu-with-linux-commands-a-detailed-guide
Analysis, Management, and Monitoring of Nvidia GPU with Linux Commands: A Detailed Guide – Domenico Soriano
nvtop is a command that behaves similarly to Linux’s top command but is specific to Nvidia GPUs. This tool provides a real-time overview of GPU and memory consumption. ... This command will display an interactive output providing a real-time snapshot of GPU usage.
🌐
Computer How To
arstech.net › nvidia-gpu-utilization
How To Monitoring NVIDIA GPU Utilization In Linux - ARSTECH
February 17, 2020 - How To Monitoring NVIDIA GPU Utilization In Linux The NVIDIA GPU Utilization In Linux can be checked with nvidia-smi command. Usage example: ~$ nvidia-smi dmon -i 0 Below you can see my NVIDIA GeForce GTX 1080ti graphic card output example: ...
🌐
LinuxVox
linuxvox.com › blog › nvidia-on-linux
NVIDIA on Linux: A Comprehensive Guide — linuxvox.com
Create or edit the /etc/X11/xorg.conf ... · Once the NVIDIA drivers are installed, you can run graphics-intensive applications such as games or 3D modeling software....
🌐
Google Cloud
cloud.google.com › compute engine › monitoring gpu performance on linux vms
Monitoring GPU performance on Linux VMs | Compute Engine | Google Cloud Documentation
The Ops Agent, version 2.38.0 or later, can automatically track GPU utilization and GPU memory usage rates on your Linux VMs that have the agent installed. These metrics, obtained from the NVIDIA Management Library (NVML), are tracked per GPU ...
🌐
LinuxVox
linuxvox.com › blog › gpu-utilization-linux
GPU Utilization on Linux: A Comprehensive Guide — linuxvox.com
If you have installed the NVIDIA drivers, nvidia-smi is usually installed by default. You can check if it is available by running the following command: ... This command will display information such as GPU usage, memory usage, temperature, and power consumption.
🌐
University of North Carolina
help.rc.unc.edu › gpumonitor
Research Computing GPU Resources
Note nvidia-smi only provides a snapshot of the GPU. We suggest monitoring your GPU for a few iterations of your code to get a sense of the maximum GPU memory usage and utilization of your code. A useful tool you can use for this task is the Linux watch command.