so my old GPU died a few days ago and I was thinking which brand of GPU to get next. AMD or Nvidia? I’ve heard Nvidia drivers are very annoying with Linux but I’ve never had an AMD GPU before. Which would be better? I’ll sometimee switch to Windows to play specific games as well.
I was running a LLM earlier this evening and my 3090 started to make a ticking noise everytime a token was generated. Panicing, I look for the first time in years at AMD’s lineup. A 7900 XTX goes for $1400 CDN, but a 4090 is almost $2500.
I also use Daz Studio/Iray to render characters before feeding them to Stable Diffusion, because it’s a lot easier to get exactly what you want without spending hours tweaking prompts and seeds and hoping for the best.
An extra grand isn’t really that bad when you factor in the lifetime of the card.
If it’s a ZOTAC card it might just click when the fans start and stop. My ZOTAC 3060 makes a click when the fans start and stop. It’s a good way to know when my PC wakes itself up lol
Naw this was a click everytime a token was generated, and they were generating really slowly so I knew something was wrong. I think it was bouncing off the 24GB memory limit and something was being tripped, so I changed the loader from AutoGPQ to ExLlama_HF and everything works fine now.