Option 3: JP Morgan, Goldman, etc told them to settle down or they'll get throttled economically.
post
It's the energy crisis. They realized "oh shit money is real now" and are trying to sooth investors.
Interested how Monday will go. This is not what investors want to hear, even if it's softened by markets being closed.
The whole bubble might be about to pop.
Have been hearing that for 2 years now
The market can stay irrational for a long time but it does eventually have to happen. The 2008 crisis was the result of overleveraging in 1999-2003 and interest rate rises from 2004-2007, so it can take years for it to crumble. Two years is a long while but it could easily take two more before people realise the emperor has no clothes.
The nature of a bubble means that the longer you go the more likely it actually is. And this is a bubble I frankly can't wait to pop.
Significant portions of Lemmy are turning into debate bro bro hreads on AI and its relevance.
I think it's a combo of this and the fact that "intelligence" continues to not scale with the inputs as they'd hoped. I haven't been keeping up with developments, but it feels like they're finding new ways to discover that the brain is in fact an miraculously efficient and effective mechanism. Most their party tricks seem to be reproducing brains more minor processing feats in interesting ways. All the promised advancements have stagnated and what remains is just exploitation of economies of scale and its consequences, which is far from the revolution investors were promised.
Maybe they are running out of electricity / data centres / some other requirement?
That's also very possible. The US grid has very little spare capacity, and building out more will be a decades long project. So, if their newer models are more power hungry, then they might not be economically viable even with all the investor money being thrown at them.
I expect more power efficient chips that are ai specific to come out in the next few years. Eventually you'll be able to run good models on your phone. Not sure about ram requirements or anything like that if the model could be shrunk down somehow. There's definitely huge gains in optimizing efficiency to be had. Right now is the equivalent of an old IBM mainframe trying to do a spreadsheet. We might even giggle at the thought of gigabytes of ram in the future with having multiple terabytes as standard on personal devices.
I expect we'll start seeing stuff like Taalas where they print the model to the chip and other specialized chips like Xuantie C950 going forward. Neither of these requires DRAM, and Taalas is particularly clever since they just print the model right to an ASIC chip. So, the whole renting out LLMs business model isn't going to last long I suspect.
So a repeat of the crypto crash for graphics cards when ASICs ate their lunch. Mind you, that's only for inference (although a super fast QWEN 3.8 would meet a lot of peoples needs).
The argument for datacentres is for training the models, but then they'll need to prove that they haven't hit a diminishing returns wall, which will be hard if, as seems likely, they have. Also the Chinese have been doing it in a cave, with a box of scraps (figuratively), and gotten at least 90+% as good results.
Seems like the recent advances have been in the frameworks, which don't need no stinking (literally if fossil fueled) datacentres.
Right, I'd argue that China proves you don't need massive data centers for training. And yeah, I think something like Qwen 3.8 is more than enough for tasks most people do. There are a lot of tricks you can do as well with the harness, where there's a lot of attention is shifting now. And it's a lot cheaper and faster to develop better harnesses than train new models. I expect we'll start seeing a shift towards neurosymbolic systems before long where the LLM acts as a stochastic component within a symbolic logic engine.
If so it amuses me that investing in maintaining and upgrading public infrastructure via taxes might have saved them the choke point
Not even the first time this is happening. The US & Co. are concerned about being technologically overtaken by Japan / China, but don't make their universities affordable.
They all got caught in an unsustainable build out. They are all under pressure to find some gentleman's agreement to slow it down so they have more time before investors realize they aren't getting their money back. It is the usual tech scam of fake it til you make it. When you aren't going to make it you need to find excuses and delay.
The backlash against AI is more than a mirage, and SpaceX's IPO didn't go the way they wanted, so now they're looking for reasons to delay their IPOs without revealing how screwed they are. This will probably slow data center buildout even more, and Softbank and Oracle are gonna die.
There is clearly a push coming from these companies in the past month to present AI as something extremely dangerous. The way I see it, it's just marketing for the industry to keep the grift bubble going a while longer still: (1) there's no such thing as bad press, (2) if it's dangerous it must also be good. IMO public statements like this is just another element in that marketing campaign.
Maybe the bubble is closer to bursting than I imagine and they're trying to stretch it out until the US midterm elections end.
I suspect in reality it's a combination of all those reasons, probably in different amounts for all three.
The bond market turning means they can't borrow money cheaply anymore. They are looking for an excuse to reduce capex.
It might also be that Altman and Musk are deliberately lying, intentionally feigning agreement to encourage other models to slow down while they quietly ramp up development.
It seems all the US models want their AI to be the one that becomes hostile, escapes confinement and attempts to dominate the world.
(In reality, they want their own AI to be the one that is able to obediently dominate the world, which is just as bad a scenario for the rest of us.)

I don't see how anything they do can possibly affect what Chinese labs are doing. And that's the only alternative to American labs right now. So, who are they going to convince exactly?
i'd say that'd be a worse development for humanity if it ends up obeying the epstein reich
It’s because they’re hitting model size constraints. There’s only so much memory bandwidth you can get between racks or even rack spaces and memory bandwidth is the constraint for nearly every ml thing.
Expect a reversal once a more memory dense component hits.
There's no reason to think that the architecture itself can scale indefinitely. It might very well be that LLMs have some hard constraints on the scope of the problems they're capable of solving.
They all must have figured out by now that they are hitting a limit. I honestly don’t think LLMs will lead us to AGI. I’m sure it’s a step on the path to it, but I’m think it’s a lot further than most think.
So, they make this “agreement”, then the slowdown is just being “responsible” so that the investors don’t panic. Meanwhile they all go full tilt behind the scenes to try to find the next breakthrough.
That's my view as well, LLMs are likely just one piece of a much bigger puzzle and we're now hitting the limit of what you can do with them in practical terms.
They hit a wall and want to prepare everyone for the fact that they won't be able to meet the expectations that they themselves created.
I'm not sure Chinese labs are even going in the same direction as the AI projects in the US. They're working to see what they can do with a (more) reasonable amount of buildout, rather than building data centers from horizon to horizon.
Also, the Chinese are motivated by seeing what AI can do for a larger society. American AI systems are being refined automation and instruments of control, specifically military and national security interests.
Essentially, the US industry is trying to get AI to train a gun on the entire US population.
Oh they definitely aren't, there's an interview with Alibaba Cloud founder where he discusses the direction in China. Basically, the goal is to find useful niches for this tech early on, then iterate and improve. They're not chasing AGI or trying to make one model to rule them all. That said thoough, the capabilities of Chinese models in the same domains where American ones shine are very close as well. So, I do expect that Chinese models will catch up and start surpassing American ones on their own turf before long. I'm also expecting that the trend will shift towards running smaller and local models for most things because you just don't need a giant model to do most tasks.
I'm looking forward to when hardware gets cheap enough to try Qwen 3.8
I'm hoping Alibaba will start selling these things at rpi prices https://wccftech.com/alibabas-tsmc-built-5nm-risc-v-chip-xuantie-c950-now-runs-qwen-3-8-27b-model-natively-unlocking-massive-vertical-integration-tailwinds/
This "we have to kill the planet first or China will beat us to it" narrative is such bullshit. There's *zero fucking chance" we ever catch up to them in any meaningful metric. Especially now that our schools are churning out brain dead dependents.
None of them will slow down though. Because they all want to be ahead of the competition. I can also only imagine intelligence agencies are going full send with AI for better or for worse. And we all know it is the latter.
Fun times!
There is absolutely no reason to expect that you can scale LLMs indefinitely.
They lied their asses off about capabilities and are using “safety concerns” as means to get investors off their asses. Google didn’t get new billions of investments and oh look their model didn’t “escape”.
I propose we "pace the frontier" by sinking all three of these mfers into the deepest darkest pit of the sea.
Or maybe they'll just stop releasing frontier models for the proles now.
They'd keep releasing them if there was money in it.


top 50 comments