Conceptually, you could just really twist the knobs up. A human can wait to read a page for 15 seconds. But you're trying to scrape 100,000 pages and they each take 15 seconds... You can make it expensive in both power and time that's a win.