Yeah this does make me wonder: even now, models need to be constantly trained with new programming languages, libraries,etc. They can ingest new documentation during a session, but they often refuse to believe it. Ex: "the project uses .Net 10, but thats clearly a typo- the current version of .Net is 8". So then if the bubble collapses and training budget drops, the models capability would suffer drastically