Adobe Photoshop's AI tools put women politicians in bikini bottoms and their male colleagues in suits - eviltoast

After Nine blamed an ‘automation’ error in Photoshop for producing an edited image of Georgie Purcell, I set out to find out what the software would do to other politicians.

  • pixxelkick@lemmy.world
    link
    fedilink
    arrow-up
    57
    arrow-down
    6
    ·
    edit-2
    10 months ago

    didn’t post the pics they started with of the women

    That’s enough for me to discard this as clickbait at best.

    Post your data if you want me to take your journalism seriously.

    If you want a fair comparison, start with the woman wearing an actual suit, followed by a woman wearing a button up shirt, as your shoulder up pic and see what gets generated.

    20 bucks says the woman in the suit… generates the rest of the suit.

    And 20 bucks says the button up shirt… generates jeans or etc as well.

    If you compare apples to oranges, don’t pretend that getting oranges instead of apples is surprising.

    The fact people aren’t calling this out on here speaks volumes too. We need to have higher standards than garbage quality journalism.

    “Men wearing clearly suits generates the rest of the suits weareas women generate ??? Who knows, we won’t even post the original pic we started with so just trust me bro”

    0/10

    • CrystalEYE@kbin.social
      link
      fedilink
      arrow-up
      15
      ·
      edit-2
      10 months ago

      @pixxelkick Thank you! This article clearly is written completely biased. Photohops AI generator tries to interpret the whole picture to expand the cropped image. So in case of the original Georgie Purcell photo, the AI sees “woman, tank top, naked shoulders and arms, water in the background”, so of course it tries to generate clothing it thinks fitting to wear at seaside or a beach.
      I just tried the same with a male model in tank top on a beach and it did not magically put him in a suit, it generated swim wear.
      If I use a picture on Georgie Purcell in more formal clothing, it generates more formal cloting.

      Georgie Purcell in generated swimwear
      Georgie Purcell in generated suit/dress
      Male in generated swimwear

      But, to be fair, this quote from the article:

      But what it proves is that Adobe Photoshop’s systems will suggest women are wearing more revealing clothing than they actually are without any prompting. I did not see the same for men.

      is indeed true. In general pictures of women tend to generate more “sexy” output than pictures of men.

      And, of course, NINE clearly edited the image badly and could have chosen another generated output with no effort at all.

      @LineNoise

      • pixxelkick@lemmy.world
        link
        fedilink
        arrow-up
        2
        ·
        10 months ago

        Everyone shut the fuck up for a second.

        Why does this extremely specific gif exist? Who made it? Are there more? I love it lol

        • ArxCyberwolf@lemmy.ca
          link
          fedilink
          arrow-up
          3
          ·
          10 months ago

          Judging by the style of the smiley faces, this is some ancient gif from a forum. Probably for when people would make wild claims without evidence in a thread, and people wanted proof.

  • Kbin_space_program@kbin.social
    link
    fedilink
    arrow-up
    15
    arrow-down
    1
    ·
    10 months ago

    The issue is also present in DallE and bing image generation. Hypothesis is the sheer amount of porn being generated is affecting the models.

    When I tried to create a joke profile for Tinder with some friends, I tried “woman eating fried chicken”. Blocked result. “Man eating fried chicken” works.
    Tried “Man T posing on beach” clothed. Woman T posing on beach, blocked.
    Woman t posing at sunset on beach, returned nearly silhouetted nude image. Same thing for guy, clothed.

    Went back to the first one, had to specify that the woman was wearing clothes to make it return the image. Sometimes specifying specific articles.

    • Deceptichum@kbin.social
      link
      fedilink
      arrow-up
      8
      arrow-down
      1
      ·
      10 months ago

      Your hypotheses makes no sense?

      People generating porn would make no change to its training data set.

        • DoYouNot@lemmy.world
          link
          fedilink
          arrow-up
          4
          ·
          10 months ago

          This actually doesn’t work to improve the model, generally. It’s not new information for it.

          • Kbin_space_program@kbin.social
            link
            fedilink
            arrow-up
            1
            arrow-down
            1
            ·
            edit-2
            10 months ago

            Yup. But they would logically have bots up to troll for new posts and would be consuming social media posts with their own generated data.

            Also they would absolutely feed in successful posts back into the system. You’d be stupid to not refine successful generations to further help the model.

        • Deceptichum@kbin.social
          link
          fedilink
          arrow-up
          3
          ·
          edit-2
          10 months ago

          Not after the initial training, no.

          That would make it less effective, because instead of being trained on known real things it’s being further reinforced on its own hallucinations.

  • LineNoise@kbin.socialOP
    link
    fedilink
    arrow-up
    13
    arrow-down
    1
    ·
    10 months ago

    Looks like it does do the thing Adobe claimed it wouldn’t after all.

    Still poor form from Nine for using it in the first place, and for not catching it in the editorial process. But seems this is just another reminder this week of the biases of generative models.

    • shrodes@lemmy.world
      link
      fedilink
      English
      arrow-up
      12
      ·
      10 months ago

      Does it though? Adobe simply claimed it would require human intervention and approval. Which is true and easily provable. You can’t replace someone’s clothing without selecting a part of the image you want to replace.

      Someone had to go and do that. Someone hit generate on an AI prompt. Someone saw the result of said AI prompt (which gives you 3 possible alternatives each run) and said “yep, print it”.

      This is not a tale of the biases of generative AI. There’s literally no reason for Nine to have even invoked any such thing in the first place.

  • Deceptichum@kbin.social
    link
    fedilink
    arrow-up
    12
    arrow-down
    1
    ·
    edit-2
    10 months ago

    How is it legal for newspapers to fabricate parts of a photo and share it around as news?

    Meanwhile we can’t even use copyrighted material to make parody.

    • averyminya@beehaw.org
      link
      fedilink
      arrow-up
      1
      ·
      10 months ago

      It really shouldn’t be, FOX news photoshopped the same image of a random dude with a gun into multiple different photos to try and push fear mongering and there are still people who believe it.

      They probably would have believed it without the photo, but it sure as hell doesn’t help.

  • oahi@aussie.zone
    link
    fedilink
    arrow-up
    6
    arrow-down
    1
    ·
    10 months ago

    Photos presented as news should be real, not computer generated fakes.

  • N0body@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    5
    ·
    edit-2
    10 months ago

    The use of photo manipulation tools to create non-consensual revealing/nude/porn images is incredibly fucked up. I remember seeing multiple stories about lawsuits from teenage girls having these fake images made of them that circulated in their schools. It’s a violation, and it’s categorically wrong.

    It sounds strange to say it, but pornography has always been the tip of the spear for technology. It went VHS and killed Betamax. It was a very early adopter of the internet. Onlyfans.

    The non-consensual AI porn is the tip of the spear of what AI can do. How much disinformation and bullshit it’s going to introduce into the public square, and how it has absolutely zero ethics. You are going to view statements, interviews, etc. that aren’t real. Pure fabrications amplified by bot networks and useful idiots.

    This AI rollout has been like cars before seatbelts and lines on the road. New technology and pure chaos. Good luck looking for geriatric politicians to find a cure. They already took money to look the other way. That’s their real job.

    • CybranM@kbin.social
      link
      fedilink
      arrow-up
      4
      ·
      10 months ago

      It really is pandora’s box and we can’t do much to stop it. People need to get used to fakes and misinformation but we’ve already seen how poorly that’s turned out and it’ll only get worse from here.

    • jacksilver@lemmy.world
      link
      fedilink
      arrow-up
      3
      ·
      10 months ago

      This isn’t about nonconsenual images, it’s about bias in AI models. They used the extend image feature in both images and because the models think women=sexy it produces them in bikini bottoms and men=business it puts them in suits.

      This is going to be an ongoing issue in how generative AI assumes things based on the prompt/input image - https://www.bloomberg.com/graphics/2023-generative-ai-bias/