The dream - eviltoast
  • tegs_terry@feddit.uk
    link
    fedilink
    English
    arrow-up
    1
    ·
    11 months ago

    What’s the human digging through answers thing? I haven’t heard anything about that.

    • OpenStars@kbin.social
      link
      fedilink
      arrow-up
      1
      ·
      11 months ago

      ChatGPT was caught, and I think later admitted, to not actually using fully automated processes to determine those answers, iirc. Instead, a real human would curate the answers first before they went out. That human might reject answers to a question like “Computer: what is 1+1?” ten times before finally accepting one of the given answers (“you’re mother”, hehe with improper apostrophe intact:-P). So really, when you were asking for an “AI answer”, what you were asking was another human on the other end of that conversation!!!

      Then again, I think that was a feature for an earlier version of the program, that might no longer be necessary? On the other hand, if they SAY that they aren’t using human curation, but that is also what they said earlier before they admitted that they had lied, do we really believe it? Watch any video of these “tech Bros” and it’s obvious in less than a minute - these people are slimy.

      And to some extent it doesn’t matter bc you can download some open source AI programs and run them yourself, but in general from what I understand, when people say things nowadays like “this was made from an AI”, it seems like it is always a hand-picked item from among the set of answers returned. So like, “oooh” and “aaaahhhhh” and all that, that such a thing could come from AI, but it’s not quite the same thing as simply asking a computer for an answer and it returning the correct answer right away! “1+1=?” giving the correct answer of 13 is MUCH less impressive when you find that out of a thousand attempts at asking, it was only returned a couple times. And the situation gets even worse(-r) when you find out that ChatGPT has been getting stupider(-est?) for awhile now - https://www.defenseone.com/technology/2023/07/ai-supposed-become-smarter-over-time-chatgpt-can-become-dumber/388826/.

      • tegs_terry@feddit.uk
        link
        fedilink
        English
        arrow-up
        1
        ·
        11 months ago

        There’s no way that’s the case now, the answers are generated way too quickly for a human to formulate. I can certainly believe it did happen at one point.

        • OpenStars@kbin.social
          link
          fedilink
          arrow-up
          1
          ·
          11 months ago

          Yes, and the fact that the quality suddenly declined awhile back - e.g. that article I linked to explained more - tracks along with those lines as well: when humans were curating the answers it took longer, whereas now the algorithm is unchained, hence able to move faster, and yet with far less accuracy than before.

      • Ookami38@sh.itjust.works
        link
        fedilink
        arrow-up
        1
        ·
        11 months ago

        So reading through your post and the article, I think you’re a bit confused about the “curated response” thing. I believe what they’re referring to is the user ability to give answers a “good answer” or “bad answer” flag that would then later be used for retraining. This could also explain the AIs drop in quality, of enough people are upvoting bad answers or downvoting good ones.

        The article also describes “commanders” reviewing and having the code team be responsive to changing the algorithm. Again this isn’t picking responses for the AI. Instead ,it’s reviewing responses it’s given and deciding if they’re good or bad, and making changes to the algorithm to get more accurate answers in the future.

        I have not heard anything like what you’re describing, with real people generating the responses real time for gpt users. I’m open to being wrong, though, if you have another article.

        • OpenStars@kbin.social
          link
          fedilink
          arrow-up
          1
          ·
          11 months ago

          I might be guilty of misinformation here - perhaps it was a forerunner to ChatGPT, or even a different (competing) chatbot entirely, where they would read an answer from the machine before deciding whether to send it on to the end user, whereas the novelty of ChatGPT was in throwing off such shackles present in an older incarnation? I do recall a story along the lines that I mentioned, but I cannot find it now so that lends some credence to that thought. In any case it would have been multiple generations behind the modern ones, so you are correct that it is not so relevant anymore.