Remember how ChatGPT totally aced the bar exam? Wow! yeah, turns out that was just a lie - eviltoast
  • exanime@lemmy.today
    link
    fedilink
    English
    arrow-up
    11
    ·
    6 months ago

    Because a machine that “forgets” stuff it reads seems rather useless… considering it was a multiple choice style exam and, as a machine, Chat GPT had the book entirely memorized, it should have scored perfect almost all the time.

    • EatATaco@lemm.ee
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      5
      ·
      6 months ago

      Chat GPT had the book entirely memorized

      I feel like this exposes a fundamental misunderstanding of how LLMs are trained.

      • TachyonTele@lemm.ee
        link
        fedilink
        English
        arrow-up
        12
        ·
        6 months ago

        They’re auto complete machines. All they fundamentally do is match words together. If it was trained on the answers and still couldn’t reproduce the correct word matches, it failed.

      • YIj54yALOJxEsY20eU@lemm.ee
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        10
        ·
        edit-2
        6 months ago

        Don’t worry friend, you are correct.

        Edit: Lets see some intelligent responses rather than downvotes. Bunch off teens majoring in “AI”.