wholookshere comments on "LLMs can do anything" except make positive cashflow.

Funny

16,311 readers

6,453 active

274 users here now

General rules:

Be kind.
All posts must make an attempt to be funny.
Obey the general sh.itjust.works instance rules.
No politics or political figures. There are plenty of other politics communities to choose from.
Don't post anything grotesque or potentially illegal. Examples include pornography, gore, animal cruelty, inappropriate jokes involving kids, etc.

Exceptions may be made at the discretion of the mods.

founded 3 years ago

moderators

[–] wholookshere@lemmy.blahaj.zone 1 point 6 days ago (1 child)

Then why do NPUs exist?

What I'm talking about exists on the smaller scale. Just a matter of time before its done on a larger.

A general purpose GPU still contains silicon for display, and video en/decoding. Those don't contribute in any meainiful way.

Not to mention it doesn't cover all of matrix math for LLM needs....

permalink

fedilink

source

parent

hideshow 1 child comment

[–] merc@sh.itjust.works 1 point 6 days ago

NPUs are low-power hardware devices for running very small AI models.

So-called "GPU"s are the devices used for similar things for the very large models that are the "hotness" right now.

A general purpose GPU still contains silicon for display, and video en/decoding

No it doesn't. The modern datacenter-style "GPU"s that nVidia has been making and selling for use in AI datacenters have stripped out all the video related elements. They're purpose built for doing only AI work these days. They can't even do standard matrix multiplication work anymore because they're so narrowly designed for AI models where they use a specialized form of lossy matrix multiplication.

The name has stuck around, but the things nVidia has been building and selling to the AI companies no longer has anything to do with graphics.

permalink

fedilink

source

parent