Right, there's this assumption that LLM improvements will just keep scaling indefinitely. It's far more likely that that the architecture has limits which we seem to be approaching, and then you just get diminishing returns, so the graph looks more like a sigmoid where we saw a ton of rapid progress, and it starting to flatten out as the easy gains get plucked.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments