GitHub - oobabooga/text-generation-webui: A Gradio web UI for Large Language Models.
github.com
A Gradio web UI for Large Language Models. Contribute to oobabooga/text-generation-webui development by creating an account on GitHub.

I’m trying to use Text Generation Web UI, but I’m stuck with small models due to being limited to using a cpu that’s “Model name: Intel® Core™2 Duo CPU E7500 @ 2.93GHz” How do I set this up?

  • hackerwacker@lemmy.ml
    3·
    1 month ago

    You’re probably aware of this but just in case you’re not, LLMs are computationally intensive and a CPU from 2007 isn’t going to provide a good experience.

    That said if you get it working it would be interesting hear how well it works.