Heyho, I’m currently on a RTX3070 but want to upgrade to a RX 7900 XT
I see that AMD installers are there, but is it all smooth sailing? How well do AMD cards compare to NVidia in terms of performance?
I’d mainly use oobabooga but would also love to try some other backends.
Anyone here with one of the newer AMD cards that could talk about their experience?
EDIT: To clear things up a little bit. I am on Linux, and i’d say i am quite experienced with it. I know how to handle a card swap and i know where to get my drivers from. I know of the gaming performance difference between NVidia and AMD. Those are the main reasons i want to switch to AMD. Now i just want to hear from someone who ALSO has Linux + AMD what their experience with Oobabooga and Automatic1111 are when using ROCm for example.
I only ever used 7b large language models on my RX 6950 XT but PyTorch had or still has some nasty AMD VRAM bugs which didn’t fully utilized all of my VRAM (more like only a quarter of it)
it seems the sad truth is high performance/training of models are just not good on AMD cards as of now
Interesting
Do you only use LLMs or also stable diffusion ?