24
[AIT] what is your selfhosted local LLM stack? (lemmy.blahaj.zone)
submitted 6 days ago by to c/selfhosted@lemmy.world
54 comments fedilink hide all child comments
 

What tools and projects do you use for your local LLM chats and agents?

I'm trying to sift through the mess of LLM harness and tools to find how to really get the most out of local LLMs.

you are viewing a single comment's thread
view the rest of the comments
[–] -3 points 6 days ago (2 children)

Isn't ollama made by Meta?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 11 points 6 days ago (1 child)

    I think you're thinking of the Llama family of llm models which are owned/made by Meta.

    Ollama is an open source server software and model repository for llm models. I won't say Meta hasn't contributed to the project, but as far as I know they don't own it and didn't start it.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 6 days ago

    Oh, it could be. I don't use any online or offline AI tools. I've played around with Lumo (from Proton) when it first released bc its/was Mistral for privacy, and work tries to get people on board with AI usage (Copilot).

  • permalink
  • fedilink
  • source
  • parent