‘It gets more and more confused’: can AI replace translators? - eviltoast

A Dutch publisher has announced that it will use AI to translate some of its books – but those in the industry are worried about the consequences if this becomes the norm.

and so it begins…

  • DdCno1@beehaw.org
    link
    fedilink
    arrow-up
    7
    ·
    edit-2
    3 days ago

    Did you inform your readers that most of the translation was done by the LLM?

    • ℍ𝕂-𝟞𝟝@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      8
      ·
      3 days ago

      That’s a very good question.

      • Yes, I have.
      • It was not professional work but a private request from a loved one.
      • It was actually their idea.
      • And I was very, very sceptical about it at the idea at first and the output all throughout the process.

      I have made extensive edits to the original LLM translation, as it got a lot of things wrong. To be honest, it got a lot of the stuff that is unique to the book and that made the book special wrong, both in words, or intent, and I had to correct it. My workflow was literally putting it in the prompt, taking the output, then putting the two texts next to each other and deciding, sentence by sentence, word by word:

      • Is the translation any good? (around 95% was generally good, sometimes it trailed off, and I needed to find the point at which it started bullshitting)
      • Does it use terms that are unique in the book consistently the right way (it almost never did, I literally had a dictionary of the most frequent mistakes)
      • Could I have done it better? Do I know a way to better convey the intent? (this happened quite rarely, as it has done a near word-for-word translation, the biggest problems were idioms that made sense in one language but didn’t in another, or misgendered characters)

      All in all, I think the LLM did the heavy lifting in remembering all the odd words and grammar, and it gave me a very flawed first draft. It was 80% of the time, but like 5% of the actual creative work that goes into a translation.

      I spent 90% of my time outside the LLM, in my text editor.

      • DdCno1@beehaw.org
        link
        fedilink
        arrow-up
        2
        ·
        edit-2
        3 days ago

        That’s a very good answer.

        If I’m getting this right, this was a novel that you perhaps mentioned to your loved one, but a language barrier prevented them from reading it. They then suggested the use of an LLM to translate it, which you used as foundation to build upon. If I may ask, which story did you translate (it has to be good if you spent this much work on it) and which LLM did you use?

        I can’t see anything wrong with this. I’ve used this kind of approach using all sorts of machine translation tools going back over 20 years (not for entire books though). Let the computer do its thing, then fix mistakes - but this was always noncommercial, private use for myself, friends and relatives, as well as the occasional friendly online community. Although, I’ve also done entirely manual work, with no machine translation at all in situations when I wanted the best possible quality or where complexity and nuance made anything else impossible - like with a long list of “whisper jokes” from Nazi Germany, subversive jokes that people told each other under the punishment of death that require a ton of context no translation tool could possibly have.

        The point here is though that this is very different from a publisher doing this commercially - and you and I both know that these companies will not even allow for the bare minimum of time spent fixing mistakes made by the translation tools.

        • ℍ𝕂-𝟞𝟝@sopuli.xyz
          link
          fedilink
          English
          arrow-up
          3
          ·
          3 days ago

          No, the loved one was actually the author, it’s a children’s book actually, light fiction, think early Harry Potter for example.

          It’s a self-published hobby project, with a few dozen copies sold in the original language since there are relatively few speakers and light novels for kids are unfortunately a very small niche everywhere, and we didn’t really market it either since earning money wasn’t really the goal. The reason I’m mentioning that it was not professional work is that I’m not misrepresenting the amount of work done to someone paying me, and I’m actually interested in preserving the qualities of the original, I really don’t want to make more LLM slop, and I especially don’t want to make LLM slop out of something that has meaning to me personally. I’ve put at least a few hundred hours of manual work into it to make sure it isn’t.

          But the idea is indeed to self-publish it and sell a few copies to people who are interested. It’s not about the income (the author actually has a regular job and is freelancing in 2 others, this is literally just a hobby), it’s more about the feeling of having made something that made other people interested enough to pay five bucks for it.

          Responding to the other topic, one interesting thing about the translation that I’ve found out (and mistranslations from the LLM actually helped spark this idea), is if you can somehow convey the context to the reader, it can make it fresh and interesting and something they haven’t read before, and that’s true not just about idioms, but other cultural patterns as well.

          Think how the world and themes of Witcher was something refreshing and new for most international audiences, while in its home country it was very recognizable where the author got his material from.