I just got Oobabooga running for the first time with Llama-2, and have Automatic1111, and ComfyUI running for images. I am curious about ML too but I don’t know where this start with that one yet.

For the uninitiated, all of these tools are running offline open source (or mostly) models.

  • Kyle@lemmynsfw.com
    2·
    1 year ago

    I too find it hard to use anything other than GPT-4. It’s still so much better than other options even if the model has felt majorly nerfed compared to earlier releases.

    • Veraxus@kbin.social
      3·
      1 year ago

      Check out Wizard 30B Uncensored. IMO it’s about as good as NerfedGPT 4… except free and private.

        • Veraxus@kbin.social
          2·
          1 year ago

          I’m running it in GPT4All (CPU-based) with 64GB of RAM, and it runs pretty well. I’m not sure what you’d need if you were running it on GPU instead.

      • TheOtherJake@beehaw.orgOP
        1·
        1 year ago

        I just tried it a few hours ago. Indeed, it is quite good. I knew it when a NSFW prompt test on an uncensored model generated a stable diffusion picture of a robot skeleton and a snarky reply. Like, yay we finally have a bight spot with this one.