If I may ask, which Quantisation are you running it on? I'm on an Apple setup with oMLX and am still experimenting with finding the right balance
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
replies: