- cross-posted to:
- technology@beehaw.org
- cross-posted to:
- technology@beehaw.org
Instagram is profiting from several ads that invite people to create nonconsensual nude images with AI image generation apps, once again showing that some of the most harmful applications of AI tools are not hidden on the dark corners of the internet, but are actively promoted to users by social media companies unable or unwilling to enforce their policies about who can buy ads on their platforms.
While parent company Meta’s Ad Library, which archives ads on its platforms, who paid for them, and where and when they were posted, shows that the company has taken down several of these ads previously, many ads that explicitly invited users to create nudes and some ad buyers were up until I reached out to Meta for comment. Some of these ads were for the best known nonconsensual “undress” or “nudify” services on the internet.
I think you are missing the plot here… If a naked pic of yourself, your mother, your wife, your daughter is circulating around the campus, work or just online… Are you really going to be like “lol my nipples are lighter and they don’t know” ??
You may not get that job, promotion, entry into program, etc. The harm done by naked pics in public would just as real weather the representation is accurate or not … And that’s not even starting to talk about the violation of privacy and overall creepiness of whatever people will do with that pic of your daughter out there
I believe their point is that an employer logically shouldn’t care if some third party fabricates an image resembling you. We still have an issue with latent puritanism, and this needs to be addressed as we face the reality of more and more convincing fakes of images, audio, and video.
I agree… however, we live in the world we live in, where employers do discriminate as much as they can before getting in trouble with the law
I think the only thing we can do is to help out by calling this out. AI fakes are just advanced gossip, and people need to realize that.
But it doesn’t. Nobody who is harassed or has their prospects undermined because of AI fakes is helped by repeating that. Especially because as the technology advances the only way to verify its legitimacy will be to compare it with real intimate pictures, which the person cannot show without being exposed to the exact same treatment.
It also doesn’t help that gossip can do all that harm as well so the point is moot.
Trying to point out that this is illogical and that nudes shouldn’t even be such a big deal is an uphill battle against human emotional, social and cultural tendencies. It would take much more than some offhand comments to affect it at all, and I wouldn’t count on that shift happening before the harms of AI fakes spread.
The ubiquity of AI fakes will necessitate a cultural shift. Honestly, the world is going to be a nightmare of misinformation soon and nudes may very well be the least of our worries.
What other options do we have? An ironclad verification system for any fabricated content? Wildly harsh penalties for all caught creating it? The ship has sailed - we won’t be able to prevent it from happening.
I’d argue that overexposure will make people quickly become accustomed/nonplussed at information we don’t believe to be true and verify with the source. Look at how we treat other fabricated content - if I showed you a screencap of the Pope saying “Fuck” you’d want to verify with a source directly.
Does it seem to you that people are becoming more likely to verify sources?
Nevermind, like I just said before, how exactly do you verify fake porn with the source? Who is going to be volunteering their intimate pictures as reference? Or, do you really think all that it takes to avoid all issues is for the victim to say “that’s fake, it’s not me”?
Frankly, that sounds like pure wishful thinking to me.
In most cases, the answer should really be “It’s none of my business”, but yes, it’d involve asking the person whether they’re authentic if you needed to verify for some reason.
But yes it really is wishful thinking, because it’s honestly about to be a shitshow. People are going to start getting credibly framed for things like child porn.
“Fools! Everybody at my school is laughing at me for having a 2-incher, but little do they know it actually curves to the LEFT!”
Lol
Mine curves to the left.
On the other end, I welcome the widespread creation of these of EVERYONE, so that it becomes impossible for them to be believable. No one should be refused from a job/promotion because of the existence of a real one IMO and this will give plausible deniability.
People are refused for jobs/promotions on the most arbitrary basis, often against existing laws but they are impossible to enforce.
Even if it is normalized, there is always the escalation factor… sure, nobody won’t hire Anita because of her nudes out there, everyone has them and they are probably fake right?.. but Perdita? hmmm I don’t want my law firm associated in any way with her pics of tentacle porn, that’s just too much!
Making sure we are all in the gutter is not really a good way to deal with this issue… specially since it will, once again, impact women 100x more than it will affect men
This is a consideration that a lot of people are glossing over. Schlubby dudes might not even be affected to it at all. It’s not going to be widespread for everyone.
How should we deal with this issue then? I’m not sure what can be done about it.
That’s a good question… I’m not an expert in this area but I do think it should be criminalized to a certain extent (even if it’s hard to enforce)
Probably legislation should out some onus on the makers of these tools as well
Post your clothed full body pic
Yeah, let’s just sexually violate everyone. /s
Who the hell is upvoting this awful take? Please understand that it would never be equitable. If this became reality, it would be women and girls that were exploited the most viciously.
I guess if you don’t give a shit about people, especially women and girls, feeling safe in public at all, you would say something like this…
It’s already possible. Do you want to make it punishable by jail time? How do you prove some anon on 4chan that posts nudes of someone else actually deepfaked it?
I don’t see how this can otherwise be contained.
Yes, sex crimes deserve harsh punishments.
It’s either deepfaked, or revenge porn. Whichever charge sticks. If 4chan refuses to unmask anons posting illegal content, throw the book at 4chan. Way overdue anyway.
See previous two answers.
Okay if you want to make everything punishable by law then we simply fundamentally disagree.
Okay if you want to make everything punishable by law then we simply fundamentally disagree.