BTW, IBM/RHEL is hoping you might go for some red hat, IBM solutions for local distributed AI stuff :
- https://www.redhat.com/en/artificial-intelligence/inference#distributed-inference
- https://developers.redhat.com/products/rhel-ai/overview
- https://www.redhat.com/en/products/ai/enterprise-linux-ai
But you know, the CEO isn't biased. /s
At least they're working on letting you have access to the open source (ish) local way of working with AIs instead of just the subscription model that the others are pushing.
I did some digging into this before giving the fuck up since my computer is a potato, and I have too many fucking things to do with my time.