Spotify is going to clone podcasters’ voices — and translate them to other languages - eviltoast

A partnership with OpenAI will let podcasters replicate their voices to automatically create foreign-language versions of their shows.

  • Th4tGuyII@kbin.social
    link
    fedilink
    arrow-up
    37
    arrow-down
    3
    ·
    edit-2
    1 year ago

    The problem with this is the same problem news websites has when they started switching out their foreign language writers with AI.

    Just because you can translate what is literally being said word by word, doesn’t mean you’re translating the intent of what was being said.

    Idioms, phrases, jokes, pleasantries, etc. won’t translate into foreign languages no matter how well you can translate the literal words being said.

    If you want good quality translation, you should get someone who knows the language and the culture to do it, as they can translate what’s between the lines.

    • Obi@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      1
      ·
      1 year ago

      Shows with the budget/intent to create good quality translations will have them reviewed/refined by humans before they put it back in the voice of the host, I don’t see why they couldn’t do that.

      Shows without the budget or that just don’t care will use full-auto and I’m sure it will indeed suck.

    • Grimy@lemmy.world
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      5
      ·
      edit-2
      1 year ago

      I honestly think this a non-issue with the new llms coming out. Gpt 4 definitely understands idioms.

      Hardest part with be getting the tone down and adding proper emotion to it.

      • PixxlMan@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        1 year ago

        Honestly, I agree. Machine translation isn’t by necessity limited to “literal” translations anymore.

      • greenskye@lemm.ee
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 year ago

        There’s probably a strong English bias to that currently, but other languages will come with time

    • maniclucky@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      3
      ·
      1 year ago

      I’m with the person in this thread that pointed out that, with this, instead of translators handling an impossible amount of work, now they can edit the output to match correctly and get more done.

      Fighting the tech will fail, as history has shown. Integrating it in a healthy, useful way is what is needed.