Thinking of switching to AMD for my personal rig and I have been wondering what is the ROCm support like these days.

I know that at least in pytorch it's just a drop in replacement. Has anyone coming from CUDA encountered any problems with using ROCm in their projects? Also how is the support for pytorch geometric like?

Thank you for the help!

I've been researching hundreds of posts over the past weeks with no luck.I tried doing it docker desktop for windows, but i wouldn't mind just having a linux on another disk to boot from, and have it all there.Linux isn't my first choice, but is the only one with pytorch rocm support afaik.

I'm studying applied statistics masters program, where I will meet with ML, which is what interest me the most, by the end of the year. I want to get ready beforehand, and try out a few available options such as deepfilternet, whisper, llama2, stable difusion... i hope you can recommend me some more, but for that i first need to get anything working at all.

Here's a complete list of commands out of my notepad++ i've encountered so far, but i think i need a differently guided way to do this as i cannot get the gpu detected.

Pretty sure I read the latest versions of rocm should support gfx1100, but the in combination with which os/image, kernel, headers&modules, rocm,...

If anyone can help me set this up I'd be supper grateful.

docker run -it --privileged --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --device=/dev/kfd --device=/dev/dri --group-add video --ipc=host --shm-size 24G rocm/pytorch:latest
sudo apt list --installed
sudo apt update
sudo apt-get update
sudo apt upgrade -y

https://askubuntu.com/questions/1429376/how-can-i-install-amd-rocm-5-on-ubuntu-22-04

wget https://repo.radeon.com/amdgpu-install/5.3/ubuntu/focal/amdgpu-install_5.3.50300-1_all.deb
sudo apt-get install ./amdgpu-install_5.3.50300-1_all.deb -y --allow-downgrades

pip install --pre torch torchvision --index-url https://download.pytorch.org/whl/nightly/rocm5.5
pip install --pre torch torchvision --index-url

https://download.pytorch.org/whl/nightly/rocm5.5--allow-downgrades
wget https://repo.radeon.com/amdgpu-install/latest/ubuntu/focal/amdgpu-install_5.7.50700-1_all.deb  -y
sudo apt-get install ./amdgpu-install_5.7.50700-1_all.deb -y

sudo apt install amdgpu
sudo amdgpu-install --usecase=rocm -y
sudo apt install amdgpu-dkms -y
sudo apt install rocm-hip-sdk -y
sudo dpkg --purge amdgpu-dkms -y
sudo dpkg --purge amdgpu -y
sudo apt-get remove amdgpu-dkms -y
sudo apt-get install amdgpu-dkms -y
sudo apt autoremove
wget -q -O - https://repo.radeon.com/rocm/rocm.gpg.key | sudo apt-key add -
echo 'deb [arch=amd64] https://repo.radeon.com/amdgpu/latest/ubuntu jammy main' | sudo tee /etc/apt/sources.list.d/amdgpu.list



sudo apt install linux-modules-extra-5.4.0-64-generic linux-headers-5.4.0-64-generic
sudo apt remove linux-modules-extra-5.8.0-44-generic linux-headers-5.8.0-44-generic
sudo apt remove linux-modules-extra-5.4.0-164-generic linux-headers-5.4.0-164-generic

sudo apt --fix-broken install -y
sudo dpkg --purge amdgpu-dkms
sudo dpkg --purge amdgpu -y
sudo apt-get install amdgpu -y
sudo apt update -y
sudo apt upgrade -y


rocminfo | grep gfx
rocminfo 

Hope it's not too disorganized, commands were used in different combos on different containers from "rocm/pytorch:latest" image. As i started from there, i hoped it would have these things ready with the gpu supported out of the box. I'm probably missing something obvious to you guys.

edit:

should i just give up and get nvidia? :( I really want to support amd, 1200 vs 2000eur isn't that little to a student.

I've seen a lot of information about improving compatibility of ROCm with PyTorch which is great. At the same time I couldn't find much confirmation about it being a drop-in replacement for cuda.

I develop ml models in PyTorch locally on Linux and MacOS and train them later in the cloud. In my experience MPS proved to be a drop in replacement for CUDA allowing me to simply change device="cuda" to device="mps" and test my code. What about ROCm?