noumenon@lemmy.world to Technology@lemmy.worldEnglish · 6 months agoResearchers figured out how to run a 120-billion parameter model across four regular desktop PCsactu.epfl.chexternal-linkmessage-square7linkfedilinkarrow-up156arrow-down110cross-posted to: ai_@lemmy.world
arrow-up146arrow-down1external-linkResearchers figured out how to run a 120-billion parameter model across four regular desktop PCsactu.epfl.chnoumenon@lemmy.world to Technology@lemmy.worldEnglish · 6 months agomessage-square7linkfedilinkcross-posted to: ai_@lemmy.world
minus-squareWereCat@lemmy.worldlinkfedilinkEnglisharrow-up2·6 months agoOFC you can… I can run the 70B DeepSeek on my 16GB RX 6800 XT with 64GB RAM already…
OFC you can… I can run the 70B DeepSeek on my 16GB RX 6800 XT with 64GB RAM already…