this post was submitted on 01 May 2026
12 points (100.0% liked)
Technology
1451 readers
35 users here now
A tech news sub for communists
founded 4 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
If you have the memory, I can highly recommend Qwen3.6-35B-A3B-Q8. It's hands down the best local model I've tried. It only loads 3b params in memory too, so should run with 16gb, or you can drop to a lower quant too.
I think I tried qwen3.6 but the 8B version, and that tanked my 16GB. But I'll give the smaller one a shot!