‘Thirsty’ ChatGPT uses four times more water than previously thought - eviltoast

cross-posted from: https://lemmy.dbzer0.com/post/32023985

Writing a 100-word email using ChatGPT (GPT-4, latest model) consumes 1 x 500ml bottle of water It uses 140Wh of energy, enough for 7 full charges of an iPhone Pro Max

    • helloworld55@lemm.ee
      link
      fedilink
      arrow-up
      1
      ·
      1 month ago

      What is this system called? I’d like to read up on it. Maybe there couldnbe regulations that those kind of systems need to use grey or recycle water. Maybe they already are in some data centers too

      • SlopppyEngineer@lemmy.world
        link
        fedilink
        arrow-up
        4
        ·
        1 month ago

        Another article said they use drinking water because the water comes close to delicate components and grey water can cause issues.

      • SlopppyEngineer@lemmy.world
        link
        fedilink
        arrow-up
        18
        ·
        1 month ago

        That’s physics. For a closed loop system, the cooling has to be done with air, which is less efficient and that doesn’t work so well in say Texas in summer.

        • curbstickle@lemmy.dbzer0.com
          link
          fedilink
          arrow-up
          4
          arrow-down
          1
          ·
          edit-2
          1 month ago

          Making it a stupid design, yes.

          Edit: putting your massive heat generating data center (beyond what most DCs will do) in support of AI in Texas is stupid.

          Closed loop systems absolutely have other options in design, which ive mentioned in another comment chain.

          As terrible as they are as companies, meta, apple, and others have made much more appropriate decisions - like locating their big load DCs in cold climates, partnering with the locale to make use of the heat being generated, removing the need for power to be used to perform those tasks - making them not only efficient designs, but compared to putting a DC in Texas like a dipshit (or LA, or NV, or anywhere else with a hot climate), makes the whole thing better for the environment.

          Yes, its a stupid design.

        • Flying Squid@lemmy.world
          link
          fedilink
          arrow-up
          6
          ·
          edit-2
          1 month ago

          I am so not an engineer, so maybe this is super stupid, but would there be some way to make it a closed loop by capturing the evaporated water and then letting it travel enough of a distance that it cools off and liquefies condenses and ends up in a holding pool?

          Edit: I told you I was stupid.

          • fsxylo@sh.itjust.works
            link
            fedilink
            English
            arrow-up
            4
            ·
            1 month ago

            Probably expensive+ you’re going to lose mass no matter what because physics don’t give a shit.

          • SlopppyEngineer@lemmy.world
            link
            fedilink
            arrow-up
            3
            ·
            1 month ago

            It’s actually how a liquid cooled PCs works. The warm liquid goes to a big radiator where fans blow air on the radiator to cool things. But lots of radiators becomes expensive and takes space. You’re talking about a few hundred megawatt of heat.

            • Flying Squid@lemmy.world
              link
              fedilink
              arrow-up
              1
              ·
              1 month ago

              The space would be a problem for sure, but couldn’t you just use natural condensation to do it with a long enough pipe?

              • curbstickle@lemmy.dbzer0.com
                link
                fedilink
                arrow-up
                2
                ·
                1 month ago

                Thats one option, part of strategies for reuse of liquid cooling.

                To mention, its more energy efficient than air cooling, so there is a benefit. Smart companies though will also look to reuse strategies like using it for building heat. Larger companies will partner with the town/city to distribute the heat into town-wide systems, like for power generation or distributed heating systems, warm greenhouses, or even to dry out wood pellets for pellet stove systems.

                Going long is effectively the same as using radiators though, you’ll just need more pipe to do it without a radiator.

              • SlopppyEngineer@lemmy.world
                link
                fedilink
                arrow-up
                2
                ·
                1 month ago

                Yes, but you have to account for pressure differences. Steam condensing to water shrinks and causes big pressure changes. It’s a lot easier to either vent it or use liquid everywhere.

            • Flying Squid@lemmy.world
              link
              fedilink
              arrow-up
              4
              ·
              1 month ago

              Unless you are talking about the entire planet, I’m fairly certain rain is not part of a closed loop cooling system for a server farm.

      • Gladaed@feddit.org
        link
        fedilink
        arrow-up
        6
        ·
        1 month ago

        It improves the efficiency of the data centre because you need less expansive cooling. You need to get rid off the heat somehow.