The Extreme Cost of Training AI Models. - eviltoast
  • huginn@feddit.it
    link
    fedilink
    English
    arrow-up
    7
    ·
    2 months ago

    The latest releases ChatGPT 4o costs $600/hr per instance to run based on the discussion I could find about it.

    If OpenAI is running 1k of those models to service the demand (they’re certainly running more since queries can take 30+ seconds) then that’s 200M/yr just keeping the lights on.

      • huginn@feddit.it
        link
        fedilink
        English
        arrow-up
        2
        ·
        2 months ago

        3.4bn is their gross - we have no idea what their operating costs are since they refuse to share them.

        Some estimates say they’re burning 8 billion a year.