Lee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 9 months agoSomeone made a GPT-like chatbot that runs locally on Raspberry Pi, and you can toowww.xda-developers.comexternal-linkmessage-square18fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkSomeone made a GPT-like chatbot that runs locally on Raspberry Pi, and you can toowww.xda-developers.comLee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 9 months agomessage-square18fedilink
minus-squareDeceptichum@kbin.sociallinkfedilinkarrow-up0·9 months agoYeah but damn does it get slow. I always find it interesting how text is so much slower than image generation. I can do a 1024x1024 in probably 20s, but I get like 1 word a second with text.
minus-squareferret@sh.itjust.workslinkfedilinkEnglisharrow-up1·9 months agoLanguages are complex and, more importantly, much less forgiving to error
Yeah but damn does it get slow.
I always find it interesting how text is so much slower than image generation. I can do a 1024x1024 in probably 20s, but I get like 1 word a second with text.
Languages are complex and, more importantly, much less forgiving to error