32
AI Companies Are Terrified. (youtu.be)
submitted 2 months ago by to c/technology@lemmygrad.ml
32 comments fedilink hide all child comments
 

*Western AI companies are terrified

Anyway, what do you all think of the news?

Video is 8 minutes and 30 seconds long if you're interested.

Is it true that the DeepSeek models and that other AI model (I forgot the name already lol) can be run locally? How do they compete with Claude and OpenAI?

Also, what about that other AI thing, OpenClaw?

I am interested in AI but still very much skeptical.

I have only used Duck AI sometimes but try to avoid it.

you are viewing a single comment's thread
view the rest of the comments
[–] 6 points 2 months ago (3 children)

A minipc costing $3000 can do a working quantization, two such computers can run what is in practice a full model...

Would you able to please spec such a PC?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 6 points 2 months ago (2 children)

    https://www.bosgamepc.com/products/bosgame-m5-ai-mini-desktop-ryzen-ai-max-395 it's still below $3K. It's not the optimal Strix Halo variant if you want to cluster a few of them though (you still can use thunderbolt in this one to connect it to another one).

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 5 points 2 months ago

    Thank you! I had no idea!

    (I was curious - wanted to have an idea what would be considered feasible these days but personally would rather pay for the tokens if needed as you suggested. I am however going to use the specs of the models you suggested to learn more about how AI works in such a machine)

  • permalink
  • fedilink
  • source
  • parent