you are viewing a single comment's thread
view the rest of the comments
[–] 6 points 1 day ago

Another factor is that model capabilities are topping out, but inference costs of cheaper models are absolutely plummeting.

In other words, it’s a race to the bottom. And inference will become a dirt cheap commodity.

…And what do we need all those datacenters for if inference is dirt cheap?

  • source
  • parent