Weirdbeardgame@lemmy.ml to Self Hosted - Self-hosting your services.@lemmy.ml · 1 year ago[Question] What are some good selfhostable ChatGPT alternatives?message-squaremessage-square11fedilinkarrow-up119arrow-down12file-text
arrow-up117arrow-down1message-square[Question] What are some good selfhostable ChatGPT alternatives?Weirdbeardgame@lemmy.ml to Self Hosted - Self-hosting your services.@lemmy.ml · 1 year agomessage-square11fedilinkfile-text
minus-squarefrap129@lemmy.maples.devlinkfedilinkarrow-up5arrow-down1·1 year agoI use koboldcpp with the vicuna model. Reasonably fast generation (<1 minute) on a 4th gen i7, would probably be on par with chatgpt in terms of speed if you used a GPU.
I use koboldcpp with the vicuna model. Reasonably fast generation (<1 minute) on a 4th gen i7, would probably be on par with chatgpt in terms of speed if you used a GPU.