Some thoughts on how useful Anubis really is. Combined with comments I read elsewhere about scrapers starting to solve the challenges, I'm afraid Anubis will be outdated soon and we need something else.

you are viewing a single comment's thread
view the rest of the comments
[–] 9 points 1 year ago* (15 children)

That's the great thing about Anubis: it's not client-side. Not entirely anyways. Similar to public key encryption schemes, it exploits the computational complexity of certain functions to solve the challenge. It can't just say "solved, let me through" because the client has to calculate a number, based on the parameters of the challenge, that fits certain mathematical criteria, and then present it to the server. That's the "proof of work" component.

A challenge could be something like "find the two prime factors of the semiprime 1522605027922533360535618378132637429718068114961380688657908494580122963258952897654000350692006139". This number is known as RSA-100, it was first factorized in 1991, which took several days of CPU time, but checking the result is trivial since it's just integer multiplication. A similar semiprime of 260 decimal digits still hasn't been factorized to this day. You can't get around mathematics, no matter how advanced your AI model is.

  • source
  • parent
  • hideshow 15 child comments
  • [+] -8 points 1 year ago (14 children)

    @rtxn I don’t understand how that isn’t client side?

    Anything that is client side can be, if not spoofed, then at least delegated to a sub process, and my argument stands

  • source
  • parent
  • hideshow 14 child comments
  • [–] 6 points 1 year ago* (4 children)

    It's not client-side because validation happens on the server side. The content won't be displayed until and unless the server receives a valid response, and the challenge is formulated in such a way that calculating a valid answer will always take a long time. It can't be spoofed because the server will know that the answer is bullshit. In my example, the server will know that the prime factors returned by the client are wrong because their product won't be equal to the original semiprime. Delegating to a sub-process won't work either, because what's the parent process supposed to do? Move on to another piece of content that is also protected by Anubis?

    The point is to waste the client's time and thus reduce the number of requests the server has to handle, not to prevent scraping altogether.

  • source
  • parent
  • hideshow 4 child comments
  • [–] -2 points 1 year ago (3 children)

    @rtxn validation of what?

    This is a typical network thing: client asks for resource, server says here’s a challenge, client responds or doesn’t, has the correct response or not, but has the challenge regardless

  • source
  • parent
  • hideshow 3 child comments
  • [–] 4 points 1 year ago (2 children)

    THEN (and this is the part you don't seem to understand) the client process has to waste time solving the challenge, which is, by the way, orders of magnitudes lighter on the server than serving the actual meaningful content, or cancel the request. If a new request is sent during that time, it will still have to waste time solving the challenge. The scraper will get through eventually, but the challenge delays the response and reduces the load on the server because while the scrapers are busy computing, it doesn't have to serve meaningful content to them.

  • source
  • parent
  • hideshow 2 child comments
  • [–] -5 points 1 year ago (1 child)

    @rtxn all right, that’s all you had to say initially, rather than try convincing me that the network client was out of the loop: it isn’t, that’s the whole point of Anubis

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (9 replies)
  • load more comments (9 replies)