• AdrianTheFrog@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 month ago

    Yeah, git repositories get hit much more heavily than most websites by scrapers, as they usually go into every subdirectory/file iirc and also scrape pretty frequently