Google Researchers’ Attack Prompts ChatGPT to Reveal Its Training Data - eviltoast

ChatGPT is full of sensitive private information and spits out verbatim text from CNN, Goodreads, WordPress blogs, fandom wikis, Terms of Service agreements, Stack Overflow source code, Wikipedia pages, news blogs, random internet comments, and much more.

    • azuth@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      7
      ·
      11 months ago

      Sure they will store everything till it’s cost effective to crack the encryption, on everything some randoms send each other.

      Intelligence will do that for high profile targets, possibly unsuccessfully.

      • shea@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        1
        ·
        11 months ago

        Nah i bet you they’ll be able to crack everything easily enough one day. And they can use an llm to process the information for sentiment and pick out any discourse they deem problematic, without having to manually go through all that data. We’re already at the point where the only guaranteed safe information storage is in your mind or on an airgapped physical media

        • azuth@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          1
          ·
          11 months ago

          ‘Bet’ all you want, you are still wrong.

          Sorting vast amounts of data is already an issue for intel agencies that theoretically llms could solve. However decrypting is magnitudes harder and more expensive. You can’t use llms to decide which data to keep for decrypting since… you don’t have language data for the llms to process. You will have to use tools working on metadata (sender and receiver, method used etc).

          There’s also no reason for intelligence services to train AI on your decrypted messages, it won’t help them decrypt other messages faster, in fact it will take away resources from decryption.