The Living Web: Will there eventually be a protocol on top of (or as a part of) ActivityPub to run distributed LLMs on instances, with the LLMs feeding on the data generated by the Fediverse? - eviltoast

Last year, the corporate-dominated web came alive, much thanks to the help of corporate-owned social media platforms - how long will it take until the open sections of the web do so?

And if that has been achieved: with stuff happening in the digital world that doesn’t in the real world, it could actually be worthwile for people to immerse further into the digital world, which up until now was always the problem behind the idea of the “Metaverse” (I’m not necessarily for this; its just something that came to my mind yesterday). Could that be the actual next iteration of the web and realize what was in the past considered the “smart” web or would it be a dystopia?

And one last question that came to my mind: would it be possible to make the LLMs somehow run independently (could the blockchain maybe be finally put to some use here?) and how would all of that be experienced like from the user perspective?

  • Poplar?@lemmy.worldEnglish
    4·
    1 year ago

    Why would instances want to train an LLM on text users post? What does it mean for an LLM to be distributed?

    • blue_berry@lemmy.worldOPEnglish
      11·
      1 year ago

      But wasn’t ChatGPT trained on huge amount of data from social media, Reddit etc.? With distributed I mean that if the server fails the LLM still stays alive, like this. So I thought about fail-safe. Maybe I didn’t thought it through enough …

      • sparse_neuron@lemmy.worldEnglish
        5·
        1 year ago

        What do you mean by “stay alive”? LLMs are statistical models that require a lot of number crunching in order to output a response. That’s not something you can just host without some major costs associated (Far more than any single Fediverse instance for sure, GPUs are not cheap to rent).