you are viewing a single comment's thread
view the rest of the comments
[–] [S] 4 points 4 days ago

Right, there's this assumption that LLM improvements will just keep scaling indefinitely. It's far more likely that that the architecture has limits which we seem to be approaching, and then you just get diminishing returns, so the graph looks more like a sigmoid where we saw a ton of rapid progress, and it starting to flatten out as the easy gains get plucked.

  • source
  • parent