cross-posted from: https://piefed.ca/c/games@lemmy.world/p/1004331/ai-driving-game-players-are-burning-through-so-many-tokens-its-developer-had-to-take-out-a

The developer behind Teach My Little Sister How to Drive, a driving instruction sim where you instruct a generative-AI-powered, dynamic NPC, has been spending $1,000 dollars a day to keep the demo working.

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 6 days ago*

Theoretically.

In practice, 95% of consumer GPUs are too busy and too small to run an LLM good enough for dialogue, or a decision model smart enough to be warranted over hardcoded logic.

CPUs are too slow. NPUs aren’t universal and are, unfortunately, all but useless with modern software frameworks.

I am very much for LLM NPCs; there are some fantastic mods for such things.

But in shipping games? That can’t be jank?

It is not time. And I would never buy a game with a hard cloud dependency for SP. We will have to get past the RAMpocalypse, at the very least.

  • source
  • parent