Researchers claim GPT-4 passed the Turing test - eviltoast
    • webghost0101@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      12
      arrow-down
      5
      ·
      edit-2
      5 months ago

      To clarify:

      People seem to legit think the jury talks to the bot in real time and can ask about literally whatever they want.

      Its rather insulting to the scientist that put a lot of thought into organizing a controlled environment to properly test defined criteria.

      • technocrit@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        12
        arrow-down
        5
        ·
        5 months ago

        Its rather insulting to the scientist that put a lot of thought into organizing a controlled environment to properly test defined criteria.

        lmao. These “scientists” are frauds. 500 people is not a legit sample site. 5 minutes is a pathetic amount of time. 54% is basically the same as guessing. And most importantly the “Turing Test” is not a scientific test that can be “passed” with one weak study.

        Instead of bootlicking “scientists”, we should be harshly criticizing the overwhelming tide of bad science and pseudo-science.

        • Kogasa@programming.dev
          link
          fedilink
          English
          arrow-up
          4
          ·
          5 months ago

          I don’t think the methodology is the issue with this one. 500 people can absolutely be a legitimate sample size. Under basic assumptions about the sample being representative and the effect size being sufficiently large you do not need more than a couple hundred participants to make statistically significant observations. 54% being close to 50% doesn’t mean the result is inconclusive. With an ideal sample it means people couldn’t reliably differentiate the human from the bot, which is presumably what the researchers believed is of interest.

        • webghost0101@sopuli.xyz
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          2
          ·
          5 months ago

          The reporting are big clickbait but that doesn’t mean there is nothing left to learn from the old touring tests.

          I dont know what the goal was they had in mind. It could just as well be “testing how overhyped the touring tests is when manipulated tests are shared with the media”

          I sincerely doubt it but i do give them benefits of the doubt.