Results of the "Can you tell which images are AI generated?" survey - eviltoast

Previous posts: https://programming.dev/post/3974121 and https://programming.dev/post/3974080

Original survey link: https://forms.gle/7Bu3Tyi5fufmY8Vc8

Thanks for all the answers, here are the results for the survey in case you were wondering how you did!

Edit: People working in CS or a related field have a 9.59 avg score while the people that aren’t have a 9.61 avg.

People that have used AI image generators before got a 9.70 avg, while people that haven’t have a 9.39 avg score.

Edit 2: The data has changed slightly! Over 1,000 people have submitted results since posting this image, check the dataset to see live results. Be aware that many people saw the image and comments before submitting, so they’ve gotten spoiled on some results, which may be leading to a higher average recently: https://docs.google.com/spreadsheets/d/1MkuZG2MiGj-77PGkuCAM3Btb1_Lb4TFEx8tTZKiOoYI

  • atmur@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    ·
    1 year ago

    I just tried the survey and got 12/20, it’s interesting looking for the details that give it away and how often that lead me to the wrong answer. Comments on each image below because I thought this was neat, hopefully I’m using spoiler tags correctly.

    spoiler

    Image 1 (Incorrect): I was totally 50/50 on this one, and I guessed wrong.

    Image 2 (Correct): Glasses look wrong when looking closely. If he wasn’t wearing glasses, I think I would’ve been 50/50 on this one too.

    Image 3 (Correct): The most obvious AI generated one in the list.

    Image 4 (Incorrect): I accidentally spoiled myself on this one by clicking on your image before the survey, but there’s no way I would’ve guessed this was AI so I chose “No” to keep my result accurate.

    Image 5 (Incorrect): I thought the shoes looked kind of odd, that was the only thing I was going off of.

    Image 6 (Incorrect): I was really conflicted on this one. The floor of the boat didn’t look quite right, but not necessarily in an AI way. In the end, I thought it was AI because of the random pieces of wood in the boat. That seemed like something an AI would randomly add, but I was totally wrong.

    Image 7 (Correct): Eyes are clearly AI generated, and parts of the sword look off. If it wasn’t for those, it would be really hard to tell.

    Image 8 (Correct): The butterfly has an extra wing coming out of its back.

    Image 9 (Incorrect): This was another one I was conflicted on. I chose AI because the dirt(?) right after the waterfall seemed odd, but I was wrong.

    Image 10 (Incorrect): I was fairly confident in my guess. The resolution makes it hard to tell, but it looks like right horse is melting in that usual AI way, but I think that’s actually supposed to be the thing that connects the horses to the cart at a second glance.

    Image 11 (Correct): I couldn’t imagine an AI drawing trees like that.

    Image 12 (Correct): The break in the river in the middle of the image looks odd.

    Image 13 (Incorrect): I was 50/50 on this one, guessed wrong.

    Image 14 (Correct): This is the other one I spoiled myself on, but the highlights look super weird. I’m quite sure I would’ve guessed this was AI-generated regardless.

    Image 15 (Correct): I didn’t think an AI would generate an image with specific details like the fish bowl or Pocky that well.

    Image 16 (Correct): I almost got myself thinking this was a trick question because there’s no way an AI would generate something that accurate.

    Image 17 (Correct): This generally looks AI generated, but the pattern on the pants was a dead giveaway.

    Image 18 (Correct): The arm rest is at the same level as the chair/couch cushions?

    Image 19 (Correct): I don’t really have any comments on this one, it just didn’t look AI generated.

    Image 20 (Incorrect): This one has that AI-generated vibe, but I thought that might be intentional to make this harder. I couldn’t see any other details that made it obviously AI, so I guessed it was real. Welp.

    This was a fun survey, thanks for putting this together.