I am looking to replace my old PC, and wondering what other people use.
Do you use your own hardware? If so, what do you have? What do you think gives you the most bang for your buck at the moment?
Do you use the cloud instead? If so, why? Which service(s) do you use?
Thank you!
Thank you! How much does the GTX 1070 help, compared to simply running your training runs on a recent CPU?
Yes, the 1070 is substantially faster than CPU. Without benchmarking, I would guess 10-20x faster than a recent consumer CPU. In reality, unless you’re interested in big NLP tasks or big computer vision models, a 1070 works just fine.
A 4090 might be 10x faster, so it turns a weekend job into an afternoon, or a month into a weekend, but plenty of real work can be done with a modest setup.
If I were building something from scratch on a budget, I’d look at the best 30-series Nvidia card I can afford. If you’re using TensorFlow, TF32 is usually basically a free speed up, with PyTorch it’s a bit less stable. You should be able to build a full system with a 3060 12GB for under $1000, or with a 3090 for under $2000.