A mother and her 14-year-old daughter are advocating for better protections for victims after AI-generated nude images of the teen and other female classmates were circulated at a high school in New Jersey.

Meanwhile, on the other side of the country, officials are investigating an incident involving a teenage boy who allegedly used artificial intelligence to create and distribute similar images of other students – also teen girls - that attend a high school in suburban Seattle, Washington.

The disturbing cases have put a spotlight yet again on explicit AI-generated material that overwhelmingly harms women and children and is booming online at an unprecedented rate. According to an analysis by independent researcher Genevieve Oh that was shared with The Associated Press, more than 143,000 new deepfake videos were posted online this year, which surpasses every other year combined.

  • Dimantina@lemmy.world
    link
    fedilink
    arrow-up
    17
    arrow-down
    3
    ·
    11 months ago

    It’s harmful, especially at that age. Psychologicaly it triggers a sense of violation of person. It’s a sense of privacy being shattered.

    Also not all people experience sexual awakening/understand they are sexual beings, by 14 or even 18. It is confusing/harmful to have that forced upon you.

    Talk to a close female friend or your mother regarding how they feel about the AI deepfakr, and how they’d react in highschool if this happened to them. Really listen to the answer and you’ll gain a better understanding of the harm done.

    • DarkGamer@kbin.social
      link
      fedilink
      arrow-up
      5
      arrow-down
      15
      ·
      edit-2
      11 months ago

      It isn’t forced upon them though, they’re not even involved.

      Privacy has not been shattered because this is not something that happened in private. In fact, these nudes didn’t happen in reality at all. It’s imagined, either via AI or via human.

      Talk to a close female friend or your mother regarding how they feel about the AI deepfakr, and how they’d react in highschool if this happened to them. Really listen to the answer and you’ll gain a better understanding of the harm done.

      Said harm is because of social stigma and shame regarding perceptions of being seen nude, which is what I referred to as being weird. It is a vestige of our puritanical past that we could do without.

      Now, if these girls are being harassed, that’s a different matter, that can happen with or without deep fakes. I’m pretty sure we already have methods of dealing with that.

      • Snot Flickerman@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        15
        arrow-down
        2
        ·
        edit-2
        11 months ago

        Said harm is because of social stigma and shame regarding perceptions of being seen nude, which is what I referred to as being weird. It is a vestige of our puritanical past that we could do without.

        This has big “if you don’t have anything to hide, you have nothing to fear” energy.

        “Why would you hide behind clothes? Do you have something to hide?”

        Look man, I think our past is puritanical too. However, this is just… I don’t even know how to defend such a skeevy/creepy opinion.

        People do feel violated by such actions, even when they don’t have people harassing them. You can’t lecture us and say they don’t. You’re not the arbiter of how other people feel about things, and feeling violated has nothing to do with prudishness. That’s damage and emotional harm, and you hand-waving it away is pretty fucking gross.

        • DarkGamer@kbin.social
          link
          fedilink
          arrow-up
          3
          arrow-down
          10
          ·
          edit-2
          11 months ago

          If we were talking about someone getting photos of these people nude through their window or similar, I would agree with you, It would be a violation, but that’s not what we’re discussing.

          Feeling violated is not sufficient cause to criminalize this technology. There must be actual harm and I do not believe emotional distress over people looking at facsimiles of a nude photo clears this bar.

          If drawing an illustration of someone nude from imagination is not illegal, neither should this be.

          “Why would you hide behind clothes? Do you have something to hide?”

          AI has no idea what they look like through their clothes, it imagines it based on a data set of other nudes. Deep fakes will never show whatever they want to hide.

        • DarkGamer@kbin.social
          link
          fedilink
          arrow-up
          1
          arrow-down
          2
          ·
          edit-2
          11 months ago

          If it spreads from peers to them and affects them negatively, it’s arguably harassment, which there are existing methods for dealing with. No different than if it were an offensive doodle or mean gossip, which are also unwanted creations.

          • Flying Squid@lemmy.world
            link
            fedilink
            arrow-up
            7
            arrow-down
            1
            ·
            11 months ago

            And what happens in 15 years when an employer finds out that there are images of them doing porn on the internet? How are they going to explain it’s fake when their boss tells them that is the sort of reputation that is harmful to the company?

            • DarkGamer@kbin.social
              link
              fedilink
              arrow-up
              2
              ·
              11 months ago

              Well, if they are fake I suspect they will say that. If an employer fires them for something they did not do, that’s a huge lawsuit.

              As for proving it, I’m not sure how one does that when this technology matures. Perhaps metadata? Fake porn images have been an issue for some time but usually one can tell if they’ve been doctored, I don’t know if that’s the case with AI deep fakes in the future. Maybe we will need AI to determine if images are AI generated.

        • DarkGamer@kbin.social
          link
          fedilink
          arrow-up
          3
          ·
          edit-2
          11 months ago

          Clearly that’s the only reason why I could possibly disagree? Lol, get bent. I just don’t think we should make kids into criminals for using technology to imagine what their classmates look like naked.

          • RippleEffect@lemm.ee
            link
            fedilink
            English
            arrow-up
            2
            ·
            11 months ago

            I think they (the kids) and should face suspensions and expulsion, but legal repurcussions are an entirely different thing when you consider how many mistakes teens make. I don’t think it should be entirely free of legal repurcussions, but would agree that kids are kids.

            It’s always tough when discussing teens because some absolutely know what they’re doing to others and fully intend to be harmful, while others think they’re just performing a prank.