Google AI making up recalls that didn’t happen - eviltoast
  • CosmicTurtle0@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    47
    arrow-down
    3
    ·
    7 months ago

    Iirc cases where the central complaint is AI, ML, or other black box technology, the company in question was never held responsible because “We don’t know how it works”. The AI surge we’re seeing now is likely a consequence of those decisions and the crypto crash.

    I’d love CVS try to push a lawsuit though.

    • Natanael@slrpnk.net
      link
      fedilink
      English
      arrow-up
      30
      ·
      7 months ago

      In Canada there was a company using an LLM chatbot who had to uphold a claim the bot had made to one of their customers. So there’s precedence for forcing companies to take responsibility for what their LLMs says (at least if they’re presenting it as trustworthy and representative)

      • LordPassionFruit@lemm.ee
        link
        fedilink
        English
        arrow-up
        23
        ·
        7 months ago

        This was with regards to Air Canada and its LLM that hallucinated a refund policy, which the company argued they did not have to honour because it wasn’t their actual policy and the bot had invented it out of nothing.

        An important side note is that one of the cited reasons that the Court ruled in favour of the customer is because the company did not disclose that the LLM wasn’t the final say in its policy, and that a customer should confirm with a representative before acting upon the information. This meaning that the the legal argument wasn’t “the LLM is responsible” but rather “the customer should be informed that the information may not be accurate”.

        I point this out because I’m not so sure CVS would have a clear cut case based on the Air Canada ruling, because I’d be surprised if Google didn’t have some legalese somewhere stating that they aren’t liable for what the LLM says.

        • shinratdr@lemmy.ca
          link
          fedilink
          English
          arrow-up
          9
          ·
          7 months ago

          But those end up being the same in practice. If you have to put up a disclaimer that the info might be wrong, then who would use it? I can get the wrong answer or unverified heresay anywhere. The whole point of contacting the company is to get the right answer; or at least one the company is forced to stick to.

          This isn’t just minor AI growing pains, this is a fundamental problem with the technology that causes it to essentially be useless for the use case of “answering questions”.

          They can slap as many disclaimers as they want on this shit; but if it just hallucinates policies and incorrect answers it will just end up being one more thing people hammer 0 to skip past or scroll past to talk to a human or find the right answer.

        • Natanael@slrpnk.net
          link
          fedilink
          English
          arrow-up
          5
          ·
          7 months ago

          But it has to be clearly presented. Consumer law and defamation law has different requirements on disclaimers

    • chiliedogg@lemmy.world
      link
      fedilink
      English
      arrow-up
      27
      ·
      7 months ago

      “We don’t know how it works but released it anyway” is a perfectly good reason to be sued when you release a product that causes harm.

    • timbuck2themoon@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      7
      ·
      7 months ago

      I would love if lawsuits brought the shit that is ai down. It has a few uses to be sure but overall it’s crap for 90+% of what it’s used for.