23
Any external NPU that can be hooked to a proxmox miniPC? (lemmy.world)
submitted 3 weeks ago by to c/selfhosted@lemmy.world
27 comments fedilink hide all child comments
 

Hi! So I'm considering...maybe having an NPU or something similar to be hooked to my proxmox server, which runs in a mini PC. It's a EliteDesk 800 micro form factor. It has a Core i5 8500 CPU, which at the moment of purchase was good enough for live encoding HEVC video on Jellyfin...that was my main concern back then. But I'd like to consider the possibility of hooking maybe some docker instances or other containers to some local-only AI acceleration. Is there any NPU or cheap GPU I could hook on USB to this proxmox server to run? Has it been done before?

Thanks!

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 3 weeks ago (1 child)

Qwen3.8 is out now and blows Qwen3.6 out of the water in pretty much every metric

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 3 weeks ago*

    AFAIK there isn't a sparse 35B variant of 3.8, and I would not recommend running a dense 27B model on dual-channel DDR4 unless you are exceptionally patient. 3.6 is good enough for most things anyway, and I wouldn't expect OP to be doing heavy-duty coding tasks where you would notice the difference.

  • permalink
  • fedilink
  • source
  • parent