you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 1 year ago (3 children)

I wonder why scrapers hit my sites with millions of requests every day. Alibaba in particular is quite aggressive there.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 1 year ago (2 children)
  • [–] 3 points 1 year ago (1 child)

    Here you go. Daily stats from my defense system. All those disguised bots? ~60% of them are from Alibaba's ASN.

    It is easy to verify, too: throw up any https site, and all the crawlers will be on your neck within days.

    There is a reason why Anubis's botPolicies.yaml includes Alibaba. There's a reason why a whole lot of sites - Codeberg included - blocks their entire ASN on the firewall.

    You're welcome.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 0 points 1 year ago* (last edited 1 year ago)

    It seems like I was wrong and they do need more data. But I think they have every right to go into their enemy's imperialism tool and disrupt it however they see fit.

  • source
  • parent