you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 1 week ago (1 child)

If I may ask, which Quantisation are you running it on? I'm on an Apple setup with oMLX and am still experimenting with finding the right balance

  • source
  • parent
  • hideshow 1 child comment