Are LLMs capable of writing *good* code? - eviltoast

By “good” I mean code that is written professionally and concisely (and obviously works as intended). Apart from personal interest and understanding what the machine spits out, is there any legit reason anyone should learn advanced coding techniques? Specifically in an engineering perspective?

If not, learning how to write code seems a tad trivial now.

    • Fonzie!@ttrpg.network
      link
      fedilink
      arrow-up
      2
      arrow-down
      1
      ·
      edit-2
      3 months ago

      I asked four LLM-based chatbots over DuckDuckGo’s anonymised service the following:

      “How many r’s are there in Strawberry?”


      GPT-4o mini

      There are three “r’s” in the word “strawberry.”

      Claude 3 Haiku

      There are 3 r’s in the word “Strawberry”.

      Llama 3.1 70B

      There are 2 r’s in the word “Strawberry”.

      Mixtral 8x7B

      There are 2 “r” letters in the word “Strawberry”. Would you like to know more about the privacy features of this service?


      They got worse at the end, but at least GPT and Claude can count letters.