My current PC specs:
- Dell Precision T1700 Motherboard
- Xeon E3 1275 v3
- 32GB DDR3 1600Mhz ECC
- 7900 XTX 24GB VRAM (Transferring to new PC)
What I want in my next PC:
- MSI Z790-P Motherboard (with Dasharo)
- i9-14900k
- DDR5 192GB 5600Mhz (Non-ECC)
- 7900 XTX 24GB VRAM
Will I see any performance increase? I’m also worried about not having ECC RAM, I will be coding a lot with my LLMs (firmware development), so part of me doesn’t want to make any mistakes and future proof. I heard DDR5 has some ECC-like features, but not the same as traditional ECC. Maybe I should buy a Dell Precision 3630 motherboard which has support for upto 128GB DDR4 ECC memory? This is a dedicated LLM PC, so, not too concerned about gaming or anything.
I would like to hear your suggestions!
GPU with a ton of vran is what you need, BUT
An alternate solution is something like a Mac mini with an m series chip and 16gb of unified memory. The neural cores on apple silicon are actually pretty impressive and since they use unified memory the models would have access to whatever the system has.
I only mention it because a Mac mini might be cheaper than GPU with tons of vram by a couple hundred bucks.
And it will sip power comparatively.
4090 with 24gb of vram is $1900 M2 Mac mini with 24gb is $1000
Buying second hand 3090/7090xtx will be cheaper for better performances if you are not building the rest of the machine.