- cross-posted to:
- technology@lemmy.org
- chapotraphouse@hexbear.net
- cross-posted to:
- technology@lemmy.org
- chapotraphouse@hexbear.net
A LLM that behaves like a typical Redditor?
What possible use is that?
What possible use is that?
I’ve noticed “has this sub gotten more right wing recently?” posts reaching the top post of the day in the last 6 months or so. r/norge and r/unitedkingdom being examples. You can automate bots that change a subreddit’s consensus on certain topics by bot-spamming threads pertaining to those topics, especially in the first hour of a thread going up. I don’t know if that’s happening, or if it has more to do with the Reddit protest that saw mods abdicate their positions last June and new mods being responsible for the change… but it could also be a bit of both.
Do you propose more bots in order to steer the public opinion? That could indeed generate serious money for reddit I suppose!
Negative examples are often just as useful for training an AI as positive ones. And it all depends on what you want to use the AI for. A moderator bot, for example, needs familiarity with the whole range of user responses it might see.
That gives me actually a fun idea for a Lemmy instance, it has an automated review process that bans posts/comments that are too similar in style to reddit posts/comments.
A redditor bot is a viable example of a forum member bot.
IMO, I don’t think it can drive topics, but it could make things controversial.
A LLM that behaves like a typical Redditor? // What possible use is that?
- [You] “Chatbot, please tell me which pokemon types are strong against Fairy.”
- [Le Lebbit Moronbot] “I’m not sure if I understand, you calling me a chatbot? I’m so confused lol”
- [You] “Moronbot, please tell me which pokemon types are strong against Fairy.”
- [LLM] “Actually, you should be spelling it “Pokémon” lol”
- [You] “Moronbot, which types are strong against Fairy?”
- [LLM] “I assume you talking about fairies. Fairies are from mythology lmao”
- [You] “Did people really waste water and electricity for this trash?”
- [LLM] “Waaah, you’re toxic!!111one”
Marketing to terminally online people maybe?
Entertaining puns and pointless jokes.
This is what the 3rd party access to API was really all about.
When API access was allowed , all reddit content was effectively free: They needed to ban 3rd party apps so they could sell the accumulated content. I expect using content to train AI also factors into it.
Is it? Because when you build a bot and just scrape Reddit I don’t think you can just use the content to train AI, just like the New York Times. The API change was definitely to sell more ads and get a higher IPO, but I don’t think it was because of AI.
Am I crazy or are you arguing the same point? Scraping is not the same as API access. They closed off the API to everyone for dubious reasons so they can sell that content (both for ads and AI training)… Right??
No you’re not, the post was editted. The original one said it was all because of AI, the entire reason for the API change was to sell to AI companies.
Edit, now I’m in doubt, because if you edit a post that is shown somehow right?
Edit2, just to be clear my point is that Reddit content was never free, before and after the API change. It’s easier to get the content with a decent API, sure. But it was never free, just like the lawsuit the NY Times started.
Reddit is a trove of user built content under the guise of community. What Spez did was to say “thanks for all the free work, suckers!”, put a price sticker on it, and laughed all the way to the bank.
And this is why I’m not active on any Internet community anymore.Nevermind, I guess I just can’t help myself…And this is why I’m not active on any Internet community anymore,
you typed.
Active as in “creating meaningful contributions and contributing to the overall knowledge base”. I still shit post from time to time.
This is going to be a really weird thing to argue, but I just casually read through a bunch of your comments and they seem like meaningful contributions.
Well, I guess I can’t help myself… I’ll shitpost more from now on 😅
^ this comment right here, officer.
Somebody asked chat GPT to appear to be a normal internet user to populate the comments section to manufacture content for normal Internet users to respond to so that they can continue building up their training models.
You couldn’t see the sarcasm because it was set to “hidden”.
And that is another unintended example of why all of my post history was purged before migration.
What are they odds that they kept it in a backup?
Some 4chan users created a backup bot that auto saves every few hours, so if reddit didn’t do it already, 4chan has been doing it for a while. The bot was originally made for 4chan but repurposed for other websites, reddit included.
Yeah, it’s all too late. Shit, PRISM was 2007, so there’s a copy of everything somewhere. Obviously different ends.
Spez like people are even capable of leeching archive.org and still sell the data which was archived for good intentions.
Depends. If they were smart they backed up every content that had a certain number of upvotes and/or a certain number of paragraphs and/or responses. Just to weed out all the 2-3 word comments that no one interacted with. If OP wrote mostly those then Reddit gives a shit about them deleting those.
Welcome to the club.
Don’t cheat yourself just because there are douches that take advantage…
deleted by creator
Considering some of the very wrong and upvoted domain specific knowledge I’ve seen on Reddit over the years I’m not sure the training data is going to be useful for much beyond what every other model can do.
lol subreddits with troll names like trees vs marijuana enthusiasts. Good fun. John cena has one also but can’t recall which subreddit is actually about John cena though.
Potato salad
I can only assume they are training some specific model for something appearing more human like.
As useless as that will be considering how fucking wildly different we type
Pretty sure the result will be SchizoGPT
The legal advice in /r/legaladvice was some of the worst garbage I’ve ever seen. I have zero doubt numerous had bad outcomes, at best wasting money and time, at worst spending years in jail because of things that sub told them to say and do. Zero doubt.
That sub was mostly cops just repeating their own bad interpretation of the law. Terrible.
This is why I don’t blame anyone for editing/deleting their post history on reddit.
I do. It’s frankly selfish. Having an AI get training on my old comments costs me nothing and it results in the development of useful AI tools. Trying to sabotage that is petty and pointless. It’s not like you could somehow collect the fraction of a pittance that you think you’re owed retroactively. I never commented on Reddit thinking “awesome, I’m going to make bank on the content I’m generating here.”
People complain about the capitalist mindset of the world and then they do this. Sigh.
Defending giant corporations profiting off of uncompensated individuals, while criticizing anyone who doesn’t want to provide free labor to said corporations, is a disgusting take. Are you a CEO?
Expecting FaceDeer to not glaze AI is like expecting the sun to not rise.
Oh is that what their crusade is? I was wondering why their take was so stupid
The more accessible training data there is the easier it is for new AI projects to enter the field less dominant those “giant corporations” become.
The free labour was already freely given. If someone doesn’t want to have shitposted on Reddit for free then maybe they shouldn’t have shitposted on Reddit for free.
“if you didn’t want me to steal your intellectual property, you shouldn’t have thought of it in the first place”
No, you shouldn’t have posted it to Reddit, in which you were required to give them a perpetual license to use your IP in any way they see fit.
For the record, I’m here because Reddit pissed me off when they axed the free API, and I’m pissed at myself for not expecting it. That’s what I get for accepting their terms and conditions, I guess.
Edit: I also don’t accept the idea that using my content for training data is “fair use” when it is used to train proprietary models, especially ones in which the end user is allowed to prompt it to plagiarize or otherwise imitate my content.
So, for an example of what the other user was talking about, I’m just some guy and for my first foray inyo programming / machine learning (I kind of just threw myself into the deep end) I modified stylegan 3 and trained it on about 500g of reddit porn that I scraped off reddit.
Now, I stopped the training after about a week (it was going to take about a solid month on my rtx 2080 ti) when I found out stable diffusion existed but I learned a LOT from that experience.
I couldn’t do that now. Arguably none of that was how any of that should be done but whatever.
I’m not sure what you mean here. Nothing’s being stolen. Even if you think there needs to be permission for training an AI off of data, Reddit has that permission.
I assume you’re more of a moron than a troll, which is disappointing. Regardless, you’re not worth my time, as I don’t think any argument could convince you to have an open mind and be willing to change. Good luck out there!
I had an 11 year old account that I deleted all my old comments and posts from because of the API debacle. Does that make me selfish that I felt like Reddit wasn’t holding up its end of the unwritten agreement?
Reddit doesn’t deserve my content anymore than I deserve access from the third party API.
If you did it over the API debacle then you’re not one of the people I’m talking about here. This is about people deleting their content to prevent it from being used to train AIs.
Do you not remember the real reason why the API debacle happened in the first place was to prepare for this moment? It was always about easy access to training data, third party apps got caught in the crossfire.
That’s ignoring an awful lot of other considerations. Obviously Reddit hasn’t explained itself in a trustworthy way, but a common belief at the time is that it was to force people to use the official Reddit mobile app so they could be subject to advertising.
deleted by creator
That spells out what they were doing. It doesn’t explain why they were doing it.
Boot licker.
Selfish? Perhaps you forget why people deleted their content in the first place.
What do you think this thread is about?
It’s their comment to do with as they see fit. I can’t get mad at them for wanting to erase their presence on a site they don’t use anymore.
And I’m free to judge them however I wish for their actions and intent.
How is not wanting capitalist companies to profit off of your content not aligned with complaining about the capitalist mindset of the world? Wtf lol.
It’s the insistence that everything that people do must be compensated with money. People have spent years posting on Reddit for fun, without any thought to being paid for it, and now all of a sudden someone else is making some money so they’re demanding that they should get their slice. And doing what they can to wreck their earlier efforts when they don’t.
How does Reddit making some money licensing this stuff harm those of us who contributed to it? Is there any problem aside from “I wanna get paid!”?
Why do you think it’s about wanting a slice? They posted on Reddit with no expectation of profit. But they don’t want others to profit off it either. It’s not that complicated.
But they don’t want others to profit off it either.
And that’s why I call them selfish. It doesn’t harm them in the slightest if someone else profits off of it.
They wouldn’t have posted if they knew this was going to happen. They posted because it was fun, not for this.
They may be morally opposed to AI (as there are many valid reasons to be opposed to it), or they may just have wanted to have been able to make an informed decision before posting, but by retroactively training the AI on their posts they’ve robbed them of the agency to make that decision.
That’s why they’re upset.
They posted content on a website whose user agreement says “we can do whatever we like with the content you post here” and then go surprised-pikachu when the website goes ahead and does whatever they like with the content they posted. Frankly, I’m not tremendously sympathetic. This should have been easy to predict.
And that’s why I’m calling you either a moron or a tool. Probably both.
For me it’s a privacy matter. Going through old posts (whether human or machine learning) can nor be used for anything good.
What about people who just think “A.I.” Is dog shit and chat bots are a dumb obsession steering the industry in the wrong direction due to hype and money?
What about them? I don’t see why they’d care what AI companies are doing in that case. They’d assume they were just wasting money on this stuff.
Considering how much of Reddit is already bots, I’m sure this will end fantastically.
deleted by creator
The AI:
"IANAL so could you ELI5, so AITA?
THIS."
Ann frankly, I did Nazi that coming.
Holy shit do I hate that comment
I wish spez had a soul so it could leave his body when sexual assault questions eventually yield the phrase “snuggle struggle.”
It’s gonna be trained on everything, even the stuff from 2009, so I’m expecting less of that and more random ‘my fedora chortles intensify’ word salad
It’s funny you say that because there was a ‘hack’ for chatgpt where you could ask it something like how to build a bomb and it would refuse. But when you added TLDR it would do it.
Their content?
That’s what I was thinking
I wouldn’t be surprised if comments become their intellectual property through some terms of services bullcrap
“Reddit has given access to YOUR conversations and posts to AI companies.”. FTFY
These were created by people, for peoole, and I will ALWAYS disagree that this data is Reddit’s or any other platforms.
Don’t forget your direct messages aren’t end to end encrypted on Reddit, so now AI will be trained on your craziest “private” conversations
There’s one good news. Reddit didn’t want to pay to move all the old DMs to the new chat infrastructure. So they deleted them.
Pretty sure they just didn’t migrate to the new data structure and didn’t actually delete the raw data. They’re effectively deleted for users but not for Reddit.
now AI will be trained on your craziest “private” conversations
I have no idea what horrible thing this will do to an LLM but I’m kind of curious.
Oh no, all the times I sent or received dodo codes from randos so we could trade animal crossing items. Whatever shall I do?
Edit: I’m gonna leave this here for people to use as a resource against Reddit because it may be worth it to do something actionable.
https://thomashunter.name/posts/2023-06-19-how-to-delete-reddit-account-gdpr-ccpa
Well to be fair, everything you post and comment on Lemmy can be used in the exact same way
Well it’s not yours once you post it on some platform, tbf
Reddit is all bots, porn, ads and political shit posts. Good luck getting any useful training content out of that.
Maybe that’s the point? Training the AI to produce the blabbering bullshit that’s preferred in social media?
They don’t care if the AI produced is useful, they just want to milk as much money from their content as they can.
The API changes were almost certainly just the groundwork for this and I called it at the time. The ridiculous pricing model for API access is because it’s aimed at the hottest tech companies, not third party app developers.
The enshittification continues because it’s what neoliberalism demands. They’ll sell your content and the data they have about you and still show you ads, because that’s the most profitable. Ethics and product quality don’t even enter into it.
Liberal market gives end users choice. If they don’t choose, they get the consequences.
This is more like people choosing Trump like types and complaining. Alternative exists, choose it.
“The free market can fix it” is just another neoliberal lie, pushed precisely because it doesn’t work. Rather than holding corporations accountable, it blames the population instead.
The reality is that boycotting businesses isn’t always an option and when it is, it’s usually a luxury. Very few products are domestically and/or ethically produced and when they are, they’re extremely expensive, especially for people being fucked out of every cent by their bosses, landlords and utilities.
It’s why the most hated companies in the world continue to bring in record profits.
Regulations are the real answer, which is why neoliberals oppose them.
I really don’t care about people who behave like they are living in North Korea or who wants a North Korean World to live in.
Even Digg people could say “No, F you” to Digg superstar owners. It is just a damn URL to type.
deleted by creator
I wish it would die, because honestly some of the porn was great and Lemmy seems to be the one place on the net that doesn’t specifically ban porn, yet has none of it anyway.
I miss bodyswap and part tf captions…
Out of all things to hate Reddit for, giving data to AI isn’t something fediverse users can really criticize it for, though making money from it perhaps.
Remember: All data in federated platforms is available for free and likely already being compiled into datasets. Don’t be surprised if this post and its comments end up in GPT5 or 6 training data.The problem isn’t that AI is being trained on the data. The problem is that they locked down all third party data access so they could monetize our content. On a federated platform, everyone gets equal access and can do whatever they want with it.
We sure can criticize them for that.
After all the hue and cry I have seen over stuff like Threads and Bluesky federation I don’t imagine most people using the Fediverse have a particularly coherent philosophy on the matter.
If they could read right now they would be very upset.
If they already, essentially, cut off API access then it’s not a big leap to limit access on the web to logged in users only and rate limit or ban accounts that behave like scrapers.
That would matter more if it wasn’t trivial to make new accounts and very cheap to buy established ones.
No. I can. Reddit was bought out, uses volunteers to control all the subs but forcefully removes you from the sub you created and were supposed to have control over if you didn’t play by their ever-changing rules, ruined/eliminates third party apks by demanding WAY over ad revenue profits to have access to api with a very short notice, and shadow banned anyone and everyone in a position to do anything about any of it. It’s a corporation that gutted an entire platform in order to push agendas they want and milk as much money out of it as possible. Hell, it’s the entire reason all of lemmy gets more than 30 posts a day. So many people switched to lemmy over the past year. They ruined a website I enjoyed and I’d rather them not make more money from the thousands of posts I made from over a decade of being there.
With reddits severe bot problem, it’ll be like training on unfiltered sewage. Garbage in, garbage out.
Machines training machines? How perverse!
Damn it. I haven’t deleted my account due to how many people I’ve supported and helped, I stopped using it while ago. It seems I’ll have to.
I wouldn’t bother. They’ll just mark all your stuff DELETED=1 and feed it to their AI anyway.
That’s not a bad idea.
I’m kind of puzzled by this mindset. You were pleased with supporting and helping people before, but now supporting and helping is bad?
I’m happy that everyone has the support, but not that some specific AI can monetize that same support. I left on my Reddit account ways to contact me (including Lemmy). I helped others so good vibes could reach them, not for making the rich richer.
Fortunately there are a lot of open source models these days too.
One of the original Reddit memes was quite prescient:
Where’s my cut?
You signed it all away the moment you scrolled down that EULA 😂
Can’t wait for the day a major court declares EULAs universally nonbinding outside of the most common-sense terms. Even though I doubt it will ever happen.
“We can store and display your content and use stuff you publicly post as examples in advertisements for our platform” is pretty common sense.
“We can use the things you post to do complex data analytics to package and sell your identity to advertisers” is fucking sus.
“We can use the things you post to train ANN generative systems to build next-generation technologies to impersonate you and your peers” is simply nuts.
The idea that displaying an EULA with an “agree” button is informed consent is just preposterous. Even lawyers don’t read them.
Seems like it would never stand up in court. Prove that -I- agreed to anything. To do that, you first have to prove that nobody has ever created an account under my name, and more importantly, prove that Reddit accounts have never been hacked and that the person who clicked the button was even in my household. And if they keep that extensive of records to where they can follow every action taken by every user on the platform, it also implies that they are tracking my personal actions even before I agreed to anything.
On the other hand, do they actually have a EULA? It’s been almost 14 years since I created my account, and there certainly wasn’t anything about selling my data for AI training when I signed up. If they change the terms of service, they are responsible for notifying everyone, otherwise they can’t claim that anyone agreed to these changes.
I’m sure their lawyers could weasel their way through it some how, but it still seems to come down to them claiming they changed the agreement without notification but the users should still be legally bound by the new terms?
Oh, is that what those things do?
Spez is playing the world’s tiniest violin for you as you read this
Well tell him to play it better because he sucks at that too.
The classic “screw everyone else, I want mine.”
What fraction of a penny do you think you’re owed?
What fraction of a penny do you think you’re owed?
250,000,000/1
Hey, you didn’t specify that it couldn’t be an improper fraction and I like money. It’s loophole time baby!
Good luck with that.
Who needs luck when you have math?
Removed by mod
Funny, I thought that is what the unblockable ads were for.
Removed by mod
No it didn’t.