23
Any external NPU that can be hooked to a proxmox miniPC? (lemmy.world)
submitted 3 weeks ago by to c/selfhosted@lemmy.world
27 comments fedilink hide all child comments
 

Hi! So I'm considering...maybe having an NPU or something similar to be hooked to my proxmox server, which runs in a mini PC. It's a EliteDesk 800 micro form factor. It has a Core i5 8500 CPU, which at the moment of purchase was good enough for live encoding HEVC video on Jellyfin...that was my main concern back then. But I'd like to consider the possibility of hooking maybe some docker instances or other containers to some local-only AI acceleration. Is there any NPU or cheap GPU I could hook on USB to this proxmox server to run? Has it been done before?

Thanks!

you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 3 weeks ago (2 children)

google coral is what you need, there's also an m.2 pcie version, also intel igpu also has limited AI capabilities through openvino, i use it to accelerate AI features in Immich (face and object recognition) on my N100 based NAS, but it's a bit too slow for Frigate realtime object recognition for example

  • permalink
  • fedilink
  • source
  • hideshow 2 child comments
    •
  • [–] 2 points 3 weeks ago (1 child)

    A little warning about the google coral, it seems not maintained anymore by google and there can be a few issues in the future. I have it for Frigate (7 cameras) and I still manage to have an inference speed < 10ms (but it detects people, not objects)

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 2 weeks ago*

    Seems like i've come late to the show then. I was about to get Frigate running on my optiplex micropc and was going to buy a Coral TPU. But if the are not sold anymore I may be stuffed with image recognition? My idea was proxmox->vm->frigate which seems to be the reccomended way of doing.

  • permalink
  • fedilink
  • source
  • parent