My current PC specs:
- Dell Precision T1700 Motherboard
- Xeon E3 1275 v3
- 32GB DDR3 1600Mhz ECC
- 7900 XTX 24GB VRAM (Transferring to new PC)
What I want in my next PC:
- MSI Z790-P Motherboard (with Dasharo)
- i9-14900k
- DDR5 192GB 5600Mhz (Non-ECC)
- 7900 XTX 24GB VRAM
Will I see any performance increase? I’m also worried about not having ECC RAM, I will be coding a lot with my LLMs (firmware development), so part of me doesn’t want to make any mistakes and future proof. I heard DDR5 has some ECC-like features, but not the same as traditional ECC. Maybe I should buy a Dell Precision 3630 motherboard which has support for upto 128GB DDR4 ECC memory? This is a dedicated LLM PC, so, not too concerned about gaming or anything.
I would like to hear your suggestions!
Have you tried ollama ? Some (if not all) models would do inference just fine with your current specs. Of course, it all depends on how many queries per unit of time you need. And if you wanted to load a huge codebase and pass it as input. Anyway, go try out.