• AdrianTheFrog@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    ·
    18 days ago

    Yeah, git repositories get hit much more heavily than most websites by scrapers, as they usually go into every subdirectory/file iirc and also scrape pretty frequently