Lee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 8 months agoWant a more private ChatGPT alternative that runs offline? Check out Janbgr.comexternal-linkmessage-square29fedilinkarrow-up1258arrow-down112
arrow-up1246arrow-down1external-linkWant a more private ChatGPT alternative that runs offline? Check out Janbgr.comLee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 8 months agomessage-square29fedilink
minus-squareInfiltrated_ad8271@kbin.sociallinkfedilinkarrow-up11arrow-down1·8 months agoThe question is quickly answered as none is currently that good, open or not. Anyway it seems that this is just a manager. I see some competitors available that I have heard good things about, like mistral.
minus-squarejune@lemmy.worldlinkfedilinkEnglisharrow-up3·8 months ago3.5 fuckin sucks though. That’s a pretty low bar to set imo.
minus-square🇸🇵🇪🇨🇺🇱🇦🇹🇪🇷@lemmy.worldlinkfedilinkEnglisharrow-up2·8 months agoI think a good 13B model running on 12GB of VRAM can do pretty well. But I’d be hard pressed to believe anything under 33B would beat 3.5.
The question is quickly answered as none is currently that good, open or not.
Anyway it seems that this is just a manager. I see some competitors available that I have heard good things about, like mistral.
Local LLMs can beat GPT 3.5 now.
3.5 fuckin sucks though. That’s a pretty low bar to set imo.
I think a good 13B model running on 12GB of VRAM can do pretty well. But I’d be hard pressed to believe anything under 33B would beat 3.5.