cross-posted from: https://piefed.zip/c/privacy/p/717792/massive-leak-shows-erotic-chatbot-users-turned-womens-yearbook-pictures-into-ai-porn
Chatbot roleplay and image generator platform SecretDesires.ai left cloud storage containers of nearly two million of images and videos exposed, including photos and full names of women from social media, at their workplaces, graduating from universities, taking selfies on vacation, and more.



So this is really gross obviously but the question of should it be illegal, and if so, where is the line, is going to be an interesting one moving forward. Getting an AI to draw a naked picture of someone for you is illegal? Comissioning an artist to draw a naked picture? What if it’s just an original character who “happens to look like x person”? Learning to draw and making one yourself? Does it involve disseminatation vs personal use? If you make a nude picture of someone else but no one ever knows does it even matter? What if you have legal rights to their image? Would not want to be a lawyer involved in that field in the future, oof.
Should be illegal to use someone else’s photograph without permission for the purpose of creating erotic works.
There. Finished. Easy.
If you wanna scribble a charcoal drawing of your crush and upload it to AI to try to make something erotic: legal, not relevant to this law; that’s your own art. Same as if you make a painting currently.
If you take someone images off their social media and send it to a sad person’s AI to generate porn: illegal.
If they give you permission: legal.
It comes down to consent and what an average person would reasonably expect, and you can be sure that a reasonable person would not expect people to take their images and make Ai porn with it.