A mother and her 14-year-old daughter are advocating for better protections for victims after AI-generated nude images of the teen and other female classmates were circulated at a high school in New Jersey.

Meanwhile, on the other side of the country, officials are investigating an incident involving a teenage boy who allegedly used artificial intelligence to create and distribute similar images of other students – also teen girls - that attend a high school in suburban Seattle, Washington.

The disturbing cases have put a spotlight yet again on explicit AI-generated material that overwhelmingly harms women and children and is booming online at an unprecedented rate. According to an analysis by independent researcher Genevieve Oh that was shared with The Associated Press, more than 143,000 new deepfake videos were posted online this year, which surpasses every other year combined.

    • Dimantina@lemmy.world
      link
      fedilink
      arrow-up
      17
      arrow-down
      3
      ·
      11 months ago

      It’s harmful, especially at that age. Psychologicaly it triggers a sense of violation of person. It’s a sense of privacy being shattered.

      Also not all people experience sexual awakening/understand they are sexual beings, by 14 or even 18. It is confusing/harmful to have that forced upon you.

      Talk to a close female friend or your mother regarding how they feel about the AI deepfakr, and how they’d react in highschool if this happened to them. Really listen to the answer and you’ll gain a better understanding of the harm done.

      • DarkGamer@kbin.social
        link
        fedilink
        arrow-up
        5
        arrow-down
        15
        ·
        edit-2
        11 months ago

        It isn’t forced upon them though, they’re not even involved.

        Privacy has not been shattered because this is not something that happened in private. In fact, these nudes didn’t happen in reality at all. It’s imagined, either via AI or via human.

        Talk to a close female friend or your mother regarding how they feel about the AI deepfakr, and how they’d react in highschool if this happened to them. Really listen to the answer and you’ll gain a better understanding of the harm done.

        Said harm is because of social stigma and shame regarding perceptions of being seen nude, which is what I referred to as being weird. It is a vestige of our puritanical past that we could do without.

        Now, if these girls are being harassed, that’s a different matter, that can happen with or without deep fakes. I’m pretty sure we already have methods of dealing with that.

        • Snot Flickerman@lemmy.blahaj.zone
          link
          fedilink
          English
          arrow-up
          15
          arrow-down
          2
          ·
          edit-2
          11 months ago

          Said harm is because of social stigma and shame regarding perceptions of being seen nude, which is what I referred to as being weird. It is a vestige of our puritanical past that we could do without.

          This has big “if you don’t have anything to hide, you have nothing to fear” energy.

          “Why would you hide behind clothes? Do you have something to hide?”

          Look man, I think our past is puritanical too. However, this is just… I don’t even know how to defend such a skeevy/creepy opinion.

          People do feel violated by such actions, even when they don’t have people harassing them. You can’t lecture us and say they don’t. You’re not the arbiter of how other people feel about things, and feeling violated has nothing to do with prudishness. That’s damage and emotional harm, and you hand-waving it away is pretty fucking gross.

          • DarkGamer@kbin.social
            link
            fedilink
            arrow-up
            3
            arrow-down
            10
            ·
            edit-2
            11 months ago

            If we were talking about someone getting photos of these people nude through their window or similar, I would agree with you, It would be a violation, but that’s not what we’re discussing.

            Feeling violated is not sufficient cause to criminalize this technology. There must be actual harm and I do not believe emotional distress over people looking at facsimiles of a nude photo clears this bar.

            If drawing an illustration of someone nude from imagination is not illegal, neither should this be.

            “Why would you hide behind clothes? Do you have something to hide?”

            AI has no idea what they look like through their clothes, it imagines it based on a data set of other nudes. Deep fakes will never show whatever they want to hide.

          • DarkGamer@kbin.social
            link
            fedilink
            arrow-up
            1
            arrow-down
            2
            ·
            edit-2
            11 months ago

            If it spreads from peers to them and affects them negatively, it’s arguably harassment, which there are existing methods for dealing with. No different than if it were an offensive doodle or mean gossip, which are also unwanted creations.

            • Flying Squid@lemmy.world
              link
              fedilink
              arrow-up
              7
              arrow-down
              1
              ·
              11 months ago

              And what happens in 15 years when an employer finds out that there are images of them doing porn on the internet? How are they going to explain it’s fake when their boss tells them that is the sort of reputation that is harmful to the company?

              • DarkGamer@kbin.social
                link
                fedilink
                arrow-up
                2
                ·
                11 months ago

                Well, if they are fake I suspect they will say that. If an employer fires them for something they did not do, that’s a huge lawsuit.

                As for proving it, I’m not sure how one does that when this technology matures. Perhaps metadata? Fake porn images have been an issue for some time but usually one can tell if they’ve been doctored, I don’t know if that’s the case with AI deep fakes in the future. Maybe we will need AI to determine if images are AI generated.

                • Flying Squid@lemmy.world
                  link
                  fedilink
                  arrow-up
                  6
                  arrow-down
                  1
                  ·
                  11 months ago

                  Well, if they are fake I suspect they will say that. If an employer fires them for something they did not do, that’s a huge lawsuit.

                  I take it you’ve never been to America before.

                  • DarkGamer@kbin.social
                    link
                    fedilink
                    arrow-up
                    1
                    ·
                    edit-2
                    11 months ago

                    I live in America, and let me tell you we love lawsuits, for better or worse. If you’re referring to at will employment states we’re beyond my expertise, I am not a lawyer.

          • DarkGamer@kbin.social
            link
            fedilink
            arrow-up
            3
            ·
            edit-2
            11 months ago

            Clearly that’s the only reason why I could possibly disagree? Lol, get bent. I just don’t think we should make kids into criminals for using technology to imagine what their classmates look like naked.

            • RippleEffect@lemm.ee
              link
              fedilink
              English
              arrow-up
              2
              ·
              11 months ago

              I think they (the kids) and should face suspensions and expulsion, but legal repurcussions are an entirely different thing when you consider how many mistakes teens make. I don’t think it should be entirely free of legal repurcussions, but would agree that kids are kids.

              It’s always tough when discussing teens because some absolutely know what they’re doing to others and fully intend to be harmful, while others think they’re just performing a prank.

    • Saganaki@lemmy.one
      link
      fedilink
      arrow-up
      10
      arrow-down
      2
      ·
      edit-2
      11 months ago

      I’m not sure if you’re trolling or not here or just lacking empathy.

      Imagine a believable image, let alone video, of you with your full name and age on it participating in a burning cross ceremony in a white hood propagating through the internet.

      This isn’t just some situation where it stays on a single person’s computer—it gets shared. And is effectively unstoppable.

      I’m not claiming of knowing a way to handle this situation, but your comment is really confusing to me that you don’t understand the harms here.

        • Saganaki@lemmy.one
          link
          fedilink
          arrow-up
          7
          arrow-down
          1
          ·
          11 months ago

          So that means it will make all images and videos not believable. That’s serious dystopian shit.

          Trust no one. Everything is fake. Nothing is real.

          • DarkGamer@kbin.social
            link
            fedilink
            arrow-up
            5
            arrow-down
            7
            ·
            edit-2
            11 months ago

            Unfortunately that’s the road we’re headed down, and if there’s an off-ramp I don’t see it. Photo and video evidence alone will not be sufficient to prove claims in the near future.

    • afraid_of_zombies@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      11 months ago

      You might be able to understand it if you imagined it happening to someone in your family, like an aunt or sister or your mother.

    • cannache@slrpnk.net
      link
      fedilink
      arrow-up
      1
      arrow-down
      9
      ·
      11 months ago

      Tbh you’ve got a point despite the downvotes, but there’s a lot of ladies out there that would be very upset with your viewpoint because they still hold onto the Madonna Whore complex

      • kase@lemmy.world
        link
        fedilink
        arrow-up
        2
        ·
        11 months ago

        I’d never heard of the Madonna-whore complex, so I looked up. According to wikipedia It’s something held by men, not women. What is your definition?

        • cannache@slrpnk.net
          link
          fedilink
          arrow-up
          1
          ·
          11 months ago

          Ask gay men. It’s certainly a thing, but I don’t think a lot of guys seriously subscribe to the thinking, we’re aware it’s a thing but from my personal experience, I would imagine that most men don’t care or prefer not to define nor judge women so quickly, it’s more like a joke of a thought experiment when you think about it.

          That’s why men can share women, but will argue over property like who drives the car, but will still spit roast a woman if they’re down for it. Also nobody knows why.