‘Thirsty’ ChatGPT uses four times more water than previously thought - eviltoast

Writing a 100-word email using ChatGPT (GPT-4, latest model) consumes 1 x 500ml bottle of water It uses 140Wh of energy, enough for 7 full charges of an iPhone Pro Max

  • ddh@lemmy.sdf.org
    link
    fedilink
    English
    arrow-up
    4
    ·
    2 days ago

    This seems a big waste of energy if that 140Wh (504,000 joules) number is correct. That amount of energy is about 2,000 times what it would take to do a very similar thing on a home PC.

    Writing a 100 word email with a 7B model would take my PC about 5 seconds, times an increased power use of 50 watts, so 250 joules.

    I get that they might be using a much larger model, but the e-mail is not going to be 2,000 times better.