Some thoughts on how useful Anubis really is. Combined with comments I read elsewhere about scrapers starting to solve the challenges, I'm afraid Anubis will be outdated soon and we need something else.

you are viewing a single comment's thread
view the rest of the comments
[–] [S] 1 point 1 year ago (1 child)

Sure, I'm not arguing against Anubis! I just don't think the added compute cost is sufficient to keep them out once they adjust.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 1 year ago

    Conceptually, you could just really twist the knobs up. A human can wait to read a page for 15 seconds. But you're trying to scrape 100,000 pages and they each take 15 seconds... You can make it expensive in both power and time that's a win.

  • source
  • parent