Remember how ChatGPT totally aced the bar exam? Wow! yeah, turns out that was just a lie - eviltoast
  • exanime@lemmy.today
    link
    fedilink
    English
    arrow-up
    11
    ·
    9 个月前

    Because a machine that “forgets” stuff it reads seems rather useless… considering it was a multiple choice style exam and, as a machine, Chat GPT had the book entirely memorized, it should have scored perfect almost all the time.

    • EatATaco@lemm.ee
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      5
      ·
      9 个月前

      Chat GPT had the book entirely memorized

      I feel like this exposes a fundamental misunderstanding of how LLMs are trained.

      • TachyonTele@lemm.ee
        link
        fedilink
        English
        arrow-up
        12
        ·
        9 个月前

        They’re auto complete machines. All they fundamentally do is match words together. If it was trained on the answers and still couldn’t reproduce the correct word matches, it failed.

      • YIj54yALOJxEsY20eU@lemm.ee
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        10
        ·
        edit-2
        9 个月前

        Don’t worry friend, you are correct.

        Edit: Lets see some intelligent responses rather than downvotes. Bunch off teens majoring in “AI”.