you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 6 days ago* (4 children)

Stm32 has made micro controllers with neural processors for years now and you don't need LLMs to do a lot of useful stuff for a spyware company. A small model can run even in really constrained hardware if you train it specifically for it. Afaik the STM32 ones are for machine vision processing on limited hardware where power is a concern. I'm sure you can do a lot more with a TV with constant power.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 4 points 6 days ago (3 children)

    That's exactly the distinction I was making. The person I was replying to said "Imagine believing that they need “AI” to record us." I was clarifying that this isn't the AI we hear so much about that requires huge datacenters; it's the kind of simple, embedded, "edge" AI that you can do with whatever microcontroller you have lying around.

  • source
  • parent
  • hideshow 3 child comments