TikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAI - eviltoast
  • jagged_circle@feddit.nl
    link
    fedilink
    English
    arrow-up
    5
    arrow-down
    4
    ·
    edit-2
    2 months ago

    Not rate limiting is bad. Hate them because of that, not because they’re a bot.

    Some bots are nice

    • Zangoose@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      2 months ago

      Even if they were rate limiting they’re still just using the bot to train an AI. If it’s from a company there’s a 99% chance the bot is bad. I’m leaving 1% for whatever the Internet Archive (are they even a company tho?) is doing.

    • zod000@lemmy.ml
      link
      fedilink
      English
      arrow-up
      3
      ·
      2 months ago

      I don’t hate all bots, I hate this bot specifically because:

      • they intentionally hide that they are a bot to evade our, and everyone else’s, methods of restricting which bots we allow and how much activity we allow.
      • they do not respect the robots.txt
      • the already mentioned lack of rate limiting