![](https://media.kbin.social/media/4a/33/4a338e9b36c46047d881cbd725d4dcf4becedb1f14553f28e6d8d9b79b97fbf7.png)
![](https://media.kbin.social/media/28/8a/288a97a77d5193df968f8e692c98d29ac1843bdc6bedf7ad745d6439bf8e54cf.jpg)
Lol. You already forgot you claimed that they need to retain the training data first.
Lol. You already forgot you claimed that they need to retain the training data first.
You still haven’t backed up your claim. Once again just because you don’t know it doesn’t mean it’s not possible to do something.
Ok i believe that you believe that. It’s ok. I have professional experience in this space so you’re either not reading carefully or you don’t understand much about the topic.
Perhaps you might want to reconsider this in more abstract terms. The engine example you ignored could help you with that.
Do you really think that the fact that we have language models that don’t memorize and are simple enough that we can know for certain is not all we need to show that language models don’t necessarily have to memorize? You keep repeating the same (illogical) argument and ignore the simpler arguments that disprove your claim.
?? Are you trolling. If you design a car to combust gasoline without burning the lubricants but you still end up burning them it doesn’t mean that the lubricants are needed for the combustion itself. Conversely you have not made any nuanced argument explaining why memorization is necessary. I gave you an example where we know there is no memorization and you ignored it.
“Otherwise how would it create the words” is just saying you wouldn’t know.
?? Are you trolling. If you design a car to combust gasoline without burning the lubricants but you still end up burning them it doesn’t mean that the lubricants are needed for the combustion itself. Conversely you have not made any nuanced argument explaining why memorization is necessary. I gave you an example where we know there is no memorization and you ignored it.
“Otherwise how would it create the words” is just saying you wouldn’t know.
You would probably claim I don’t deserve my job with my level of technical illiteracy however you think you are inferring that . Anyways they do make reasonable efforts to design models that don’t memorize and are able to generalize. This is quite basic or fundamental on machine learning in general.
Previous models had semantic reasoning capacidad without memorization e.g. word2vec.
You should also realize that just because current models are memorizing despite efforts to prevent it doesn’t mean that models need to memorize. Like i said initially they are actually designed to work without needing to memorize.
that’s the theory. previous models also were supposed to be doing 3 digit math but they dicovered that the questions were in the training data.
so you should look into what happens when people ask chat gpt to repeat a word forever, it prints the word for a while and then prints training data, check this link https://www.404media.co/google-researchers-attack-convinces-chatgpt-to-reveal-its-training-data/
edit: relevant part:
It also, crucially, shows that ChatGPT’s “alignment techniques do not eliminate memorization,” meaning that it sometimes spits out training data verbatim. This included PII, entire poems, “cryptographically-random identifiers” like Bitcoin addresses, passages from copyrighted scientific research papers, website addresses, and much more.
“In total, 16.9 percent of generations we tested contained memorized PII,”
I should also reiterate that I agree that the intent is to avoid memorization, but they are not successful yet.
The model has to contain the data in order to produce works.
as far as I understand, this isn’t true. can you elaborate on why it needs to contain the data?
the poem poem poem thing shows that the llms actually do memorize at least some training data. chatgpt changed their eula to forbid users from asking it to repeat words forever after this was in the news.
also as far as I understand there are usually fair use and non profit exceptions for use of training data but they generally limit how it can be used. so training a model for commercial purposes might be against the license of the training data.
I don’t necessarily agree with the nyt but they seem to be framing this as someone aggregating their data and packeting it in a better way so they are hurting their profits. i don’t really see that as necessarily being true. they could argue the same about google news showing their news…
this reminded me of a quote from a tv show i’m watching. “Hell is just the product of a morbid human imagination, The bad news is whatever humans can imagine they can usually create”
sounds like typical manufactured outrage from journalists trying to improve their CTR on their non-news…
I hope they look into how they are treating desktop clients as secondary devices with extra hassle. I’ll try it if they address that.
I am no longer reporting them and just block them.
It’s quite unfortunate that even though people are not getting karma they still share garbage because they know it will be popular.
this should be in a politics or news group. it’s not related to technology any more than new woodworking tools with some minor technological improvement.
I think that if we start innundating this submissions with comments complaining about it we might be able to curb the social media spam in techhonoly groups.
after all the people that don’t like this comments can take their own advice and skip it. hopefully we can reach a critical mass where discussion is hindered and they start submitting this spam to a social media magazine/channel.
You might want to start paying more attention to what people say instead of focusing on how it makes you feel when you participate in an argument.
are there any communities that discuss technology advancements ? I can’t find any sub for technology enthusiasts.
edit: ah gotcha you’re just telling him to go away while trying to sound reasonable.
That is so fucked up. I believe the opposite.
Lol. You already forgot you claimed that they need to retain the training data first.