you are viewing a single comment's thread
view the rest of the comments
[–] [S] 2 points 19 hours ago

It's hyped to all hell, but I think it will ultimately settle down to something used for many things and be mostly just assumed. But I doubt all this spend from hyperscalers will ultimately pay out the way it's being framed.

My guess? Things get scaled down so much that for most purposes, even where you might use a "frontier" model now, you could use a local model and get enough token/sec.

  • source
  • parent