ChatGPT gets code questions wrong 52% of the time - eviltoast
    • nanoUFO@sh.itjust.works
      link
      fedilink
      arrow-up
      5
      ·
      1 year ago

      Every leetcode question has been answered a billion times and you train it on those billions of answers, it should get those right.

    • OskarAxolotl@lemmy.world
      link
      fedilink
      arrow-up
      3
      ·
      1 year ago

      Probably because the model has seen thousands of possible solutions to those exact Leetcode problems. Actual questions people ask on StackOverflow tend to be much more specialized.

    • HackerJoe@sh.itjust.works
      link
      fedilink
      arrow-up
      2
      ·
      1 year ago

      But it confidently explains the wrong answers.

      I just hope politicians don’t find out how to use it. It’ll be our doom.