SocialistVibes01@lemmy.ml to Linux@lemmy.mlEnglish · 5 months agoWhich specs are as low as reasonable possible for local LLM models? Do you recommend some distro in particular?message-squaremessage-square13linkfedilinkarrow-up119arrow-down16file-text
arrow-up113arrow-down1message-squareWhich specs are as low as reasonable possible for local LLM models? Do you recommend some distro in particular?SocialistVibes01@lemmy.ml to Linux@lemmy.mlEnglish · 5 months agomessage-square13linkfedilinkfile-text
minus-squaremeowmeow@quokk.aulinkfedilinkEnglisharrow-up2·5 months agoA budget build is going to run you $4k+ for something like qwen3-coder:30b, and you’ll probably be annoyed at the speed of you’re used to Codex or Claude.
A budget build is going to run you $4k+ for something like qwen3-coder:30b, and you’ll probably be annoyed at the speed of you’re used to Codex or Claude.