you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 9 months ago (3 children)

The fuck even is an NPU? Is it like a NUC? I guess at least the N in NPU actually means something but I still hate this.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 5 points 9 months ago

    It's a big matrix multiplier that is tailored for machine learning model evaluation (not training). Often they are low precision as that's all you need for model evaluation (or "inference").

    Think of it as a much less useful GPU because it won't do graphics.

  • source
  • parent