ChatGPT gets code questions wrong 52% of the time - eviltoast
  • DPRK_Chopra [comrade/them]@hexbear.net
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 year ago

    For sure, no worries. I had the same questions as you when reading it. Fwiw, the paper is really kind of sloppy. I think it’s maybe a case of poor students not wanting to pay for GPT-4? Maybe they’ll clean it up and respond to some of the criticisms when it comes out of draft, but it doesn’t seem like very rigorous scholarship to me.

    • SirGolan@lemmy.sdf.org
      link
      fedilink
      arrow-up
      2
      ·
      1 year ago

      Yeah I think you’re right on about the students not being able to afford GPT4 (I don’t blame them. The API version gets expensive quick). I agree though that it doesn’t seem super well put together.