32
AI Companies Are Terrified. (youtu.be)
submitted 2 months ago by to c/technology@lemmygrad.ml
32 comments fedilink hide all child comments
 

*Western AI companies are terrified

Anyway, what do you all think of the news?

Video is 8 minutes and 30 seconds long if you're interested.

Is it true that the DeepSeek models and that other AI model (I forgot the name already lol) can be run locally? How do they compete with Claude and OpenAI?

Also, what about that other AI thing, OpenClaw?

I am interested in AI but still very much skeptical.

I have only used Duck AI sometimes but try to avoid it.

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 2 months ago* (6 children)

Depends on the model, but maybe it's around 16 gigs of vram, and a good gpu, but you'd need a lot more resources to make it perform as good as the one in the web interface, i tried with my nvidia gtx 1660 ti 6 GB vram and the models that were available to me weren't really clever

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [–] 6 points 2 months ago* (1 child)

    You need 128GB of VRAM for aggressive quantization of DeepSeek Flash. 16GB might be enough for aggressive quantization of smaller models. In theory you can run Qwen3.6 27B in 2-bit quantization (or something like https://huggingface.co/prism-ml/Ternary-Bonsai-27B-gguf ) and have some space for context but it's a toy. You need at least 24GB of VRAM to use reasonable quant of Qwen3.6 27B (or 32GB of shared VRAM to handle Qwen3.6 35BA3B which is faster but takes more VRAM than 27B) in actual tasks.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] [S] 2 points 2 months ago (3 children)

    So basically needs more power, huh...

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 9 points 2 months ago (2 children)

    Based on the other comments a lot more, the whole ai crash isn't really about regular consumers but big companies that prefer to host their own ai instead of paying open ai and anthropic

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] [S] 8 points 2 months ago

    Honestly, the development of AI (not it happening but HOW it happened) has been very interesting and somewhat hopeful to me.

    This is because the companies that control this technology don't have full control and basically are fighting each other for it.

    Really fascinating ngl

  • permalink
  • fedilink
  • source
  • parent
  • [–] 3 points 2 months ago

    I'd say it's even more about medium sized and small companies (and also companies that aren't focused on IT primarily) being able to have an actual choice of a provider and providers being forced to compete for a price.

  • permalink
  • fedilink
  • source
  • parent