Some thoughts on how useful Anubis really is. Combined with comments I read elsewhere about scrapers starting to solve the challenges, I'm afraid Anubis will be outdated soon and we need something else.

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 1 year ago

LLMs can't just run chromium unless they're tool aware and have an agent running alongside them to facilitate tool use. I highly suspect that AI web crawlers aren't that sophisticated.

  • source
  • parent