this post was submitted on 01 Apr 2025
227 points (97.1% liked)

Technology

68187 readers
3661 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
L4s@hackingne.ws
227
GenAI website goes dark after explicit fakes exposed (www.theregister.com)
submitted 1 day ago by Alphane_Moon@lemmy.world to c/technology@lemmy.world
89 comments fedilink hide all child comments
top 50 comments
sorted by: hot top controversial new old
[–] Mohamed@lemmy.ca 43 points 1 day ago (5 children)

Generated AI CP should be illegalized even if its creation did not technically harm anyone. The reason is, presumably it looks too close to real CP, so close that it: 1) normalizes consumption of CP, 2) grows a market for CP, and 3) Real CP could get off the hook by claiming it is AI.

While there are similar reasons to be against clearly not real CP (e.g. hentai), this type at least does not have problem #3. For example, there doesnt need to be an investigation into whether a picture is real or not.

[–] Nyoka@lemm.ee 3 points 6 hours ago

Fun fact it's already illegal. If it's indistinguishable from the real thing it's a crime.

[–] Ilovethebomb@lemm.ee 11 points 21 hours ago (2 children)

What the fuck is AI being trained on to produce the stuff?

[–] funkless_eck@sh.itjust.works 2 points 5 hours ago

if you have a soup of all liquids and a sieve that only lets coffee and ice cream through it produces coffee ice cream (metaphor, don't think too hard about it)

that's how gen ai works. each step sieves out raw data to get closer to the prompt.

[–] JohnEdwa@sopuli.xyz 23 points 21 hours ago (2 children)

Pictures of clothed children and naked adults.

Nobody trained them on what things made out of spaghetti look like, but they can generate them because smushing multiple things together is precisely what they do.

[–] Blackmist@feddit.uk 6 points 9 hours ago

Given the "we spared no expense" attitude to the rest of the data these things are trained on, I fear that may be wishful thinking...

[–] Ilovethebomb@lemm.ee 6 points 20 hours ago

Well, that's somewhat reassuring.

Still reprehensible that it's being used that way, of course.

[–] jacksilver@lemmy.world 20 points 1 day ago

The biggest issue with this line of thinking is, how do you prove it's CP without a victim. I suppose at a certain threshold it becomes obvious, but that can be a very blurry line (there was a famous case where a porn star had to be flown to a court case to prove the video wasn't CP, but can't find the link right now).

So your left with a crime that was committed with no victim and no proof, which can be really easy to abuse.

[–] swelter_spark@reddthat.com 9 points 23 hours ago (1 children)

AI CP seems like a promising way to destroy demand for the real thing. How many people would risk a prison sentence making or viewing the real thing when they could push a button and have a convincing likeness for free with no children harmed? Flood the market with cheap fakes and makers of the real thing may not find it profitable enough to take the risk.

[–] AnonomousWolf@lemm.ee 3 points 14 hours ago

I think it would boost the market for the real thing more.

It's possible that there are people that would become into AI generated CP if it was just allowed to be advertised on nsfw website.

And that would lead some to seek out the real thing. I think it's best to condemn it entirely

load more comments (1 replies)
[–] dumbass@leminal.space 157 points 1 day ago (19 children)

Ai cp, they found AI generated cp that had been generated on their service...

Explicit fakes makes it sound less bad.

They were allowing AI cp to be made.

[–] venusaur@lemmy.world 19 points 1 day ago (1 children)

Is “CP” so you don’t get flagged, or is it for sensitivity.

[–] dumbass@leminal.space 44 points 1 day ago (3 children)

I don't like saying the full phrase, it's a disgusting merger of words that shouldn't exist.

[–] fushuan@lemm.ee 59 points 1 day ago* (last edited 1 day ago) (1 children)

FYI, the current accepted term is csam. Children sexual abuse material. The reason why CP is wrong is that porn implies, or should imply, that there's consent on the sexual act, and children cannot consent.

You are right, it's a disgusting merger exactly because it implies something that's absolutely incorrect and wrong.

[–] ThirdConsul@lemmy.ml 0 points 9 hours ago (3 children)

If we are pedantic, I'm not sure if "children cannot consent" is correct. Children at 16 are mature enough to give consent in legal context, we as a society just frown upon older adults mingling with them.

[–] Scrollone@feddit.it 3 points 8 hours ago

When I was 16 I would have totally posed for porn and I would have been completely consenting. But it would have been illegal. I wonder where we should draw the line, and if the current one is the best one.

[–] BussyGyatt@feddit.org 1 points 8 hours ago

buddy, theres a whole range of ages between 0 and 16, and i use that number 0 advisedly.

[–] fushuan@lemm.ee 0 points 6 hours ago* (last edited 6 hours ago)

Legally speaking children can't consent, which is why it's illegal and the basis of my statement. I wasn't being pedantic, I was showing a new terminology.

Different legislations have different consent ages, but in the internet we should go by the highest one since anything can be viewed from anywhere.

[–] kippinitreal@lemmy.world 25 points 1 day ago (1 children)

Very true, thanks for your sensitivity @dumbass

[–] Flocklesscrow@lemm.ee 14 points 1 day ago (4 children)

It's pronounced "doo mah."

[–] kippinitreal@lemmy.world 7 points 1 day ago* (last edited 1 day ago) (1 children)

Wow so its from the duh region in france, here I thought it was just sparkling dumbass

[–] mjhelto@lemm.ee 1 points 10 hours ago

Nope, it's the fully alcoholic dumbass, not that shitty grape juice variety!

load more comments (3 replies)
load more comments (1 replies)
load more comments (18 replies)
load more comments
view more: next ›