I successfully ran local Llama with llama.cpp and an old AMD GPU. I'm not sure why you think there's no other option.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
replies:
I successfully ran local Llama with llama.cpp and an old AMD GPU. I'm not sure why you think there's no other option.