TikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAI - eviltoast
  • Olgratin_Magmatoe@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    2 months ago

    It has nothing to do with a sysadmin. It’s impossible for a given request to require zero processing power. Therefore there will always be an upper limit to how many get requests can be handled, even if it’s a small amount of processing power per request.

    For a business it’s probably not a big deal, but if it’s a self hosted site it quickly can become a problem.

    • jagged_circle@feddit.nl
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      2 months ago

      Caches can be configured locally to use near-zero processing power. Or moved to the last mile to use zero processing power (by your hardware)

        • jagged_circle@feddit.nl
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          1
          ·
          2 months ago

          Right, thats why I said you should fire your sysadmin if they aren’t caching or can’t manage to get the cache down to zero load for static content served to simple GET requests