Technology

Money corrupts.

You say it as if OpenAI started with good intentions and got corrupted by the money. But the most likely explanation is that it was a scam from the start.

I couldn't find anything about concurrency. But I assumed it's more like ~1000 users? B300 has something like 100,000+ tok/s, not sure about context size. I also was wrong on my math for the solar panels, see above. It's more like +50% costs than 10%. Obviously all of this is napkin math, but even 50% isn't too bad. My point is that with a slightly saner rollout of AI there seems to be absolutely no problem to make it sustainable. And if you buy your tokens in China you can select a data center that gets it's power from nuclear or solar.

And yeah we don't know how long they will release open weight models. Once hardware to run such open weight models become available they might change tactics. But right now China releasing these open models has a serious impact on the stock price of these AI companies, which is a good thing. The sooner the AI bubble pops the better.

And like 7 of the top 10 suppliers of tokens right now is from China apparently. What Xi himself said is that the world needs a multilateral approach and AI should not become a monopoly. And while that is clearly propaganda aimed at the global south, China does have a different approach. They spend peanuts on their AI models compared to the west (and the algorithmic breakthroughs done by Chinese AI researches afaik have also been published).

But you actually can use an existing model to generate training data for a new model. Which is what the US corporations are currently accusing China of doing, which is of course hilarious. Of course China has generated huge amounts of training data themselves. So basically any industrial country could in the future fund a research effort to produce a new AI model and make it open weights. A monopoly situation would be another huge issue with AI.

Basically in regulation, sustainability and democratizing access China is doing very good. And in poking the AI bubble.

One example would be the ai data centers Musk has that he illegally had gas generators installed at. The fine compared to not running them at all is small in comparison to keep them on. This is why it needs to be a percentage or increasing stack of cost not just a small fine every time.

Well that’s one way to speed run environmental catastrophe.

Man I want your supplier for batteries and panels tbh.

A single DGX B300 that could run Kimi for a few concurrent users, uses 14 kW. Costs about 500k. Assuming you live far enough from the equator to have seasons, you'll have about 8 hours of daytime at the worst points of the year (less at my latitude for an example, we get ~6 hour days in the dead of winter, with sun angles below 10 degrees and sunshine available... not every week)

Even in a slightly less extreme location, You'd be looking at roughly a 100 kW array to fill the battery and power that one server reliably like when there's clouds, about 300 kWh battery capacity to get through long nights. Easily 6 figures total cost, maybe 20-40% of the server itself. This assumes no electricity used for cooling, so it's very much back of the envelope math, reality could be much worse or a tiny bit better depending on your latitude.

But...but...but... the RAGE! With a measured approach to topics like that, HOW AM I SUPPOSED TO FUEL THE RAGE!?!?!?!11

That always blows my mind, still. If you ever grew cherry tomatoes, you know how long it takes and how much it yields. Even the smalltest corner super market has cherry tomatoes, every day of the year. It's not even a necessity, it's just there.