Hallucinating sources - eviltoast
    • Perplexity is the only one I would think of using seriously, and then only when I want it to, say, summarize something I already know.

      After which I fact-check it like crazy and hammer at it until it gets things right.

      One annoying habit it has is that somewhere in the chain of software before or after the LLM it looks for certain key topics it doesn’t want to talk about and either comes out and says it (anything involving violence or crime) or has a visibly canned hot take that it repeats without variance no matter what added information you provide or how much cajoling you try.

      At other points it starts into the canned responses, but when you catch it it will try again. Like I frequently want song lyrics translated and each time I supply some that it recognizes as such it throws up a canned response about how it will not be a party to copyright breaking. Then after a few rounds back and forth about how I’m clearly not doing this commercially and am just a fan who wants to understand a song better it will begrudgingly give me the translation.

      Then five minutes later in the SAME CONVERSATION it will run through that cycle all over again when I give it another song.

      Lather. Rinse. Repeat.

    • shawn1122@lemm.ee
      link
      fedilink
      English
      arrow-up
      9
      ·
      1 day ago

      Perplexity is by far the best for searching but still copiously hallucinates.