Over just a few months, ChatGPT went from correctly answering a simple math problem 98% of the time to just 2%, study finds - eviltoast
  • remotedev@lemmy.ca
    link
    fedilink
    arrow-up
    25
    ·
    1 year ago

    I’ve tried to use it for debugging by copying code into it, and it gives me the same code back as the corrected version. I was wondering why it’s been getting worse

    • TheSaneWriter@lemmy.thesanewriter.com
      link
      fedilink
      arrow-up
      23
      arrow-down
      1
      ·
      1 year ago

      My guess is they’ve been trying to make it cheaper by decreasing the amount of time it spends on each response or by decreasing the amount of computing power that goes into the instance you’re speaking to. Coding and math are products of high-level cognition and arise emergently out of neural networks that are very sophisticated, but take just a bit of power out and the abilities degenerate rapidly.

    • agissilver@lemmy.world
      link
      fedilink
      arrow-up
      3
      arrow-down
      1
      ·
      1 year ago

      I also experienced this issue last week. I asked for a specific correction and got unchanged code back. Sometimes it does update, though. Maybe like 50-70% of requests.