OpenAI has built a text watermarking method to detect chatgpt written content - eviltoast

Am I missing something? The article seems to suggest it works via hidden text characters. Has OpenAI never heard of pasting text into a utf8 notepad before?

    • pup_atlas@pawb.social
      link
      fedilink
      English
      arrow-up
      16
      ·
      3 months ago

      I van totally believe that it detects AI generated content 99% of the time, that’s trivial. What I really wanna know is the false positive rate. If I write a program that flags everything, it’d have a 100% hit rate. It’d also however have a crazy high false positive rate.

      • Womble@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        ·
        edit-2
        3 months ago

        Yup, noticable that they use the phrase “99.9% effective”. Effective doesnt have a defined meaning in this contect, unlike accuracy, sensitivity or specificity, so that smells of missleading PR speak to me.