Are LLMs capable of writing *good* code? - eviltoast

By “good” I mean code that is written professionally and concisely (and obviously works as intended). Apart from personal interest and understanding what the machine spits out, is there any legit reason anyone should learn advanced coding techniques? Specifically in an engineering perspective?

If not, learning how to write code seems a tad trivial now.

  • Fonzie!@ttrpg.network
    link
    fedilink
    arrow-up
    2
    arrow-down
    1
    ·
    edit-2
    4 months ago

    I asked four LLM-based chatbots over DuckDuckGo’s anonymised service the following:

    “How many r’s are there in Strawberry?”


    GPT-4o mini

    There are three “r’s” in the word “strawberry.”

    Claude 3 Haiku

    There are 3 r’s in the word “Strawberry”.

    Llama 3.1 70B

    There are 2 r’s in the word “Strawberry”.

    Mixtral 8x7B

    There are 2 “r” letters in the word “Strawberry”. Would you like to know more about the privacy features of this service?


    They got worse at the end, but at least GPT and Claude can count letters.