What can we do to make Lemmy more resilient - eviltoast

What would be the best thing to do to help keep lemmy.world up? Donate? Servers? What is the best way to help?

    • Kalcifer@lemmy.world
      link
      fedilink
      arrow-up
      42
      arrow-down
      1
      ·
      1 year ago

      That’s actually not a terrible idea. Lemmy really needs content. It doesn’t necessarily matter what that content is, it Is just really starving for activity in general. So anything that you post is a huge help.

      • pjhenry1216@kbin.social
        link
        fedilink
        arrow-up
        8
        ·
        1 year ago

        Lemmy needs content. Lemmy.world needs resources or even just for people to spread out into other instances. It’s the fediverse after all. You don’t even need to have or use Lemmy to enjoy Lemmy content.

  • nothacking@discuss.tchncs.de
    link
    fedilink
    arrow-up
    46
    arrow-down
    1
    ·
    edit-2
    1 year ago

    Move to a different instance to spread the load. You can see all the same content from any other instance, but the experience will be a lot better with less lag.

    Lemmy is not the same as lemmy.world.

    The problem with lemmy.ml and lemmy.world is that they are just too popular and instances don’t scale well.

    • Serinus@lemmy.ml
      link
      fedilink
      English
      arrow-up
      24
      arrow-down
      2
      ·
      1 year ago

      I don’t understand how a million tiny instances is supposed to scale better than a few big instances.

      Caching all the data from another instance is overhead. If you’re not serving that to enough people, your instance is going to create more traffic than it reduces.

      1-10 person instances can’t possibly help. Maybe 10,000 users on an instance is valuable for scaling.

      • Blaze (he/him)@sopuli.xyz
        link
        fedilink
        arrow-up
        11
        ·
        1 year ago

        I would indeed say 1000-5000 users instance should be the soft spot. Having a look at https://lemmy.fediverse.observer/list and filter by 1m (monthly active users) shows that 27k are on Lemmy.world, while Lemmy.ml is second with only 3,8k.

        A healthier solution would be to have all the small instances (imagine the 25 biggest, so up to Lemmy.zip) to gain users, so that LW would be less critical

        • kmkz_ninja@lemmy.world
          link
          fedilink
          arrow-up
          5
          ·
          1 year ago

          Is there any functional difference between 4 people funding and running 1 instances vs 4 people funding and running 4 instances?

          • Blaze (he/him)@sopuli.xyz
            link
            fedilink
            arrow-up
            4
            ·
            1 year ago

            Scale that to a few millions on 1 instances and you get Reddit, so there is at least a difference in terms of decision making

          • Serinus@lemmy.ml
            link
            fedilink
            English
            arrow-up
            2
            ·
            1 year ago

            Their ALL feeds will only have their individual servers unless their users go to the other instances and subscribe to communities. And only the communities they subscribe to will be fetched. But they’ll be fetched for all users on your instance with only one sub.

            (Technically they’re pushed and not fetched.)

      • sabreW4K3@lemmy.tf
        link
        fedilink
        English
        arrow-up
        6
        ·
        1 year ago

        There are certain things that are memory intensive and CPU intensive. If you have 10k on one server doing that it really adds up. However having them across a wide range of smaller servers, its not such a big deal.

        As a user, you literally lose out on nothing not being on lemmy.world. You can partake in all the same conversations, communities and everything. In fact when lemmy.world is down, you can still see everything and when it comes back up, your posts will synchronize. There’s genuinely no upside to being on lemmy.world. That’s the way the system was designed.

      • nothacking@discuss.tchncs.de
        link
        fedilink
        arrow-up
        1
        ·
        edit-2
        1 year ago

        Each instance only downloads relieve content to its users. An instance with a popular community will have to handle all the posts made to that community, which will still be much smaller than all of them. While the overall load might be higher, the load on any given instance will be lower.

        Images, by far the biggest bandwidth user, are directly transfered from posting instance to client and are not federated. Having more instances will spread out that load very effectively.

    • Polar@lemmy.ca
      link
      fedilink
      arrow-up
      13
      ·
      1 year ago

      You can see all the same content from any other instance

      Nah. I moved from ml to world to .ca, and .ca is the best. I didn’t realize how much content ml and world defederated from. I love it on .ca

      • maporita@unilem.org
        link
        fedilink
        arrow-up
        5
        ·
        1 year ago

        I moved from lemmy.ml to unilemmy who specifically don’t defederate from anyone. So they treat people as adults who can decide for themselves what they want to see. If you don’t like something just block it … simple.

  • 1984@lemmy.today
    link
    fedilink
    arrow-up
    28
    arrow-down
    2
    ·
    edit-2
    1 year ago

    Spread out to one of the other 1300 instances maybe?

    Fediverse means federated. Not one instance.

    Donating to lemmy.world because it has become too big seems like a self inflicted problem.

  • pjhenry1216@kbin.social
    link
    fedilink
    arrow-up
    20
    ·
    1 year ago

    Honestly, everyone not joining lemmy.world would help. Also, not confusing Lemmy and lemmy.world as the same thing. If you have an alt account on another server, consider making it your permanent account. It’s the fediverse. You don’t need to be on lemmy.world to see lemmy.world.

    • pyrflie@lemmy.world
      link
      fedilink
      arrow-up
      4
      ·
      1 year ago

      Honestly having a list of what makes instances different would help. I have two lemmy accounts right now and figuring out which instance to pick after Limmy.world is tough.

      And I only want maximum federation. I’m willing to do my own moderation and curation, just not hosting. Though that may come later if needed.

      • 1984@lemmy.today
        link
        fedilink
        arrow-up
        4
        arrow-down
        1
        ·
        1 year ago

        I’m really happy at Lemmy.today - federates with everyone, no downvotes and fast instance. Just needs more users.

            • can@sh.itjust.works
              link
              fedilink
              arrow-up
              4
              ·
              1 year ago

              The vlemmy situation. Just make sure they defederate instances hosting things illegal in their home state.

                • can@sh.itjust.works
                  link
                  fedilink
                  arrow-up
                  2
                  ·
                  edit-2
                  1 year ago

                  Vlemmy was .net

                  They federated with an instance that was hosting content that was illegal in the country vlemmy was hosted in.

      • mnemonicmonkeys@sh.itjust.works
        link
        fedilink
        arrow-up
        1
        ·
        1 year ago

        Imo, the main difference between instances are the admin’s attitudes.

        Beehaw.com wants to be walled off for curation, lemmy.ml is a general server for tankies that don’t want to troll and serves as a test bed for the devs, lemmy.world wants to be a general hub, sh.itjust.works also wants to be a general hub that puts more value on letting people manage their own content

    • Starzil@lemm.ee
      link
      fedilink
      arrow-up
      3
      ·
      1 year ago

      Yeah, I originally made an account in like early June in Lemmy.world then I made this account recently to not add to the load. Haven’t touch other account ever since.

  • YeetMe@lemmy.world
    link
    fedilink
    arrow-up
    19
    ·
    1 year ago

    Two things I can see, needs to be on scalable infrastructure rather than a few hosts running docker-compose. Needs to have support for in-memory key/value stores for caching. Either of these would probably help out a bit. Donate to the developers or instance maintainer and either could happen.

    • Mwalimu@baraza.africa
      link
      fedilink
      arrow-up
      7
      ·
      1 year ago

      It will also help to evolve towards some form of immutable governance for the instances. By this I mean an instance should be more than the individual admin(s). If such an individual was to tire off, get distracted etc, the instance does not suffer the same fate. Technical federation is one thing. Federated governance is a whole different issue. I am not advocating for formal organizations (but those would help in some cases), but rather a clear provision for instance-continuity beyond the current admins.

      • honk@feddit.de
        link
        fedilink
        arrow-up
        8
        ·
        1 year ago

        Me and a handful of friends started a formally registered non profit in germany. Not internet related but art related stuff and it was surprisingly easy, fast and even more surprising the regulations and requirements actually make sense. That is the way to go to secure that no admin ever goes nuts and takes an entire instance with them lmao.

        I‘m fairly certain that similar organizations exist in most countries snd the process should be relatively similar.

        • Mwalimu@baraza.africa
          link
          fedilink
          arrow-up
          4
          ·
          1 year ago

          This is the way to go. Gives some reasonable grounds to commit to an instance when you expect it will be up in a month. We are also trying that with Baraza with a trusteeship kind of design.

      • pjhenry1216@kbin.social
        link
        fedilink
        arrow-up
        1
        ·
        1 year ago

        I don’t see this being a thing. In many cases, the admins own and pay for it. If they stop, it’s not really like they’ll just keep paying for it and have someone else run it.

    • Jourei@lemm.ee
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      I’ve heard that post migration is a big task, every instance has to re-appoint the posts to the new one. I’d love to have the feature though.

  • Pansen@lemmy.world
    link
    fedilink
    arrow-up
    8
    ·
    1 year ago

    If I create an account on a small instance and that instance shuts down, will I not lose my account and post history?

    • 1984@lemmy.today
      link
      fedilink
      arrow-up
      7
      ·
      edit-2
      1 year ago

      Yes. This is one of the risks picking a small instance. On the other hand, all instances were small once. Most still are. And you should help them grow instead of sitting on the largest one.

      Instances that grow are much less likely to shut down. I only know a few instances that have shut down actually, so I don’t think it’s a large risk. We wouldn’t have 1300 instances if they would shut down often.

      I know it’s only been a few months since Lemmy got a lot of new users. So we will see how it plays out. But for a healthy Lemmy ecosystem, there should be hundreds of active instances with lots of people.

  • hellishharlot@lemmy.world
    link
    fedilink
    arrow-up
    7
    ·
    1 year ago

    I’ve been creating accounts on other servers as well so that I can protect the username and also have a certain amount of per acct specializations.

    • YeetMe@lemmy.world
      link
      fedilink
      arrow-up
      2
      ·
      1 year ago

      The cost quickly adds up for small underfunded projects though. You also need to factor in how the application does scale. What kind of ingress/load balancing is required. What kind of stateful storage is required. Network policy. Resource monitoring. Config management, CI/CD pipeline. I setup a basic cluster on gke to start but haven’t gotten around to building these just yet. I’ve got a goal of attempting the most performant, scalable, and cheapest instance out there.

    • MrSpArkle@lemmy.ca
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      That’s the easy part. Next part is identifying which app endpoints are the most intensive and splitting them off into separate deployments.

      The hard part is scaling the database, as I’ve only seen one tool that can autoshard effectively, but it’s for MySQL, not Postgres.

  • Destragras@kbin.social
    link
    fedilink
    arrow-up
    2
    arrow-down
    9
    ·
    1 year ago

    Have any instances considered taking money for running advertisements? I don’t mean the type where they are shoved between posts or following you down the page with flashing animated gifs, but subtle banners that may appear at the top or the side of the page.