‘Thirsty’ ChatGPT uses four times more water than previously thought - eviltoast

Writing a 100-word email using ChatGPT (GPT-4, latest model) consumes 1 x 500ml bottle of water It uses 140Wh of energy, enough for 7 full charges of an iPhone Pro Max

  • interdimensionalmeme@lemmy.ml
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 month ago

    They have already reached diminishing returns on training. It will become much less frequent soon. Retraining on the same data if there isn’t a better method is useless. I think the ressources consumed per query should only include those actually used for inference. The rest can be dismissed as bad faith argumentation.