There are a series of quants available at much smaller sizes such that you don’t need the full size model. The full fp16 model is 23 GB but the fp8 quant is half that, and there are GGUF quants down to 6.8 GB.

Oobabooga is a pretty beginner-friendly solution for running LLMs locally. Models are freely available on Huggingface, but look for GGUF quantizations that will fit in your VRAM. The good thing about GGUFs is that they’re typically offered in a wide range of sizes so you can pick one that will fit on your GPU. If you use all your VRAM and start offloading to system memory then the generation will be far slower.

I’ve had the best results with Noromaid20B and Rose20B quants running on a 16GB 4080. Don’t expect it to be as smart as GPT 4.0, but those models do a pretty good job of following instruction and writing decent prose.

Once you mess around with Oobabooga a bit, I’d highly recommend picking up the SillyTavern front-end. Oobabooga runs the actual model while SillyTavern manages characters, world lore, and offers a wide range of other features including a “visual novel” mode where you can set up character sprites that emote based on the content of the messages. It takes a while to get the hang of but it’s pretty cool.

Okay, science guy, but can I use it to replace human workers? I don’t really get all this computer stuff, but I need something to tell the shareholders.

The thing is that I do want to have my subscriptions and favorite channels, and as long as UBO blocks ads, I haven’t fully made the switch to a different front-end.

But it still bothers me that it serves me far-right, religious, and conspiracy theory content given that I’ve never once engaged with any of those topics.

I didn’t read the argument as saying one platform’s behavior excuses the other. I saw it as saying that both are bad.

It certainly doesn’t come across as a defense of either platform to say they’re both infested by Nazis.

I have no idea why you’re being downvoted since you’re 100% correct. I watch one video about gaming and YouTube’s recommendations are all alt-right anti-feminist stuff with Ben Shapiro and Jordan Peterson.

Google surely knows enough about me to know I lean far-left but the algorithm is determined to feed me that slop.

I have no idea from a technical perspective if Odysee’s algorithm is independent from or worse than YouTube’s, but the criticism of YouTube is completely valid.

deleted by creator

Neither Meta nor anyone else is hand-curating their dataset. The fact that Facebook is full of grandparents sharing disinformation doesn’t impact what’s in their model.

But all LLMs are going to have accuracy issues because they’re 1) trained on text written by humans who themselves are inaccurate and 2) designed to choose tokens based on probability rather than any internal logic as to whether an answer is factual.

All LLMs are full of shit. That doesn’t mean they’re not fun or even useful in some applications, but you shouldn’t trust anything they write.

It’s a war on both, but especially on LGBTQ people. The fundamentalists are anti-porn in the same way that they are anti-sex in other ways, like opposing sex education.

But it is absolutely part of their strategy to define anything LGBTQ-related as sexual or pornographic, and therefore to criminalize any public visibility of LGBTQ people.

Every metric! Miles per gallon! Head of cattle per acre! Every possible metric!

But what if you’re not in london

This is what, their fourth?

Only since 2018. Before then I was born on 1/1/1990.

I said in my original post that just typing a prompt isn’t an example of skill. I stated that there are people who use both AI and non-AI tools in complex workflows that include a ton of manual work, and in those cases it’s disingenuous to write off the process as not being creative.

I’m not sure exactly what you’re arguing against, but it isn’t the position I took. Seems like a reading comprehension issue.

I’d welcome you to offer a rigorous definition of this supposedly well-known distinction. Computers don’t generate anything spontaneously. They always require some level of direction.

Are the outputs of VSTs not “computer generated”? You can fumble around on a keyboard just moving up and down until you find the pitch you want, and the software will output an orchestral swell of dozens of instruments that take years and years to master, with none of that effort expended by the one mashing the keyboard.

Is that sound computer-assisted or computer-generated in your estimation? Much the same with AI images. It’s not fundamentally different from any other computerized tool.

Depends on the workflow, in my opinion. There are people who just type “1girl lol” into a text box and there are some people who set up workflows with hundreds of steps including significant manual work done in Photoshop or GIMP.

Similarly nearly all music these days is made with a DAW, which enables you to selectively edit and combine performances that otherwise you wouldn’t be able to achieve. Drummer off beat? Quantize it. Want a string section but don’t know how to play violin? Use a synth. And certainly there are people who are overly reliant on those tools because their core music abilities aren’t very strong.

If you think any amount of computer assistance means that something isn’t art, then basically all music made since the 90s would also not be art. It’s not a binary. Any tool can be used tastefully or be used to mask an underlying lack of talent.

Not to mention convenient transport in a Mad Max-style apocalypse, until the fuel runs out.

Who would be attracted to this billionaire sex symbol, who’s one of the most successful performers on the planet? Madness, I tell you.

Detroit Pizza is my favorite pizza style. I love a good New York pizza but the toasty favors and tang of detroit style are my favorite by far. I got the special pan to make it, and Charlie Anderson on YouTube has a fantastic recipe.

Is this a definition common in a specific country outside the U.S.? I see this claim in multiple places in the thread, but that’s not how it has been historically defined in the U.S. or in France where the term originated. Middle class in the original context evolved out of the mercantile class that traded goods in cities - neither aristocrat nor serf - during the middle ages. That original definition had nothing to do with investments.