Over just a few months, ChatGPT went from correctly answering a simple math problem 98% of the time to just 2%, study finds. Researchers found wild fluctuations—called drift—in the technology’s abi... - eviltoast

Over just a few months, ChatGPT went from correctly answering a simple math problem 98% of the time to just 2%, study finds. Researchers found wild fluctuations—called drift—in the technology’s abi…::ChatGPT went from answering a simple math correctly 98% of the time to just 2%, over the course of a few months.

  • drspod@lemmy.ml
    link
    fedilink
    English
    arrow-up
    13
    ·
    1 year ago

    They list the currently available models that users of their API can select here:

    https://platform.openai.com/docs/models/overview

    They even say that while the main models are being continuously updated (read: re-trained) there are snapshots of previous models that will remain static.

    So yes, they are storing and snapshotting the models and they have many different models available with which to perform inference at the same time.