▲ 21 ▼ [AIT] what is your selfhosted local LLM stack? (lemmy.blahaj.zone) submitted 3 days ago by Alvaro@lemmy.blahaj.zone to c/selfhosted@lemmy.world 53 comments fedilink hide all child comments What tools and projects do you use for your local LLM chats and agents? I'm trying to sift through the mess of LLM harness and tools to find how to really get the most out of local LLMs.
[–] NormDeplume@lemmy.world 1 point 1 day ago (1 child) Mind elaborating how you route them through obsidian? permalink fedilink source parent hideshow 1 child comment replies: [–] StrawberryPigtails@discuss.tchncs.de 1 point 1 day ago My Hermes agent and OpenCode both can see the same Obsidian vault. I just started working with OpenCode and haven't quite figured it out, however my Hermes agent has learned that everything I work on needs a file in Obsidian and that if it needs to look something up that it should look through Obsidian first. Prompts usually tell them to "look in the vault" or "write up what we've been doing in the vault, suitable for another agent to understand what is going on with no prior context". It's not currently all that reliable, but I've only been working with Hermes for a few months and started playing with OpenCode a few weeks ago. I need to work a bit more on orginization, though. Last time I looked in there, I backed out quickly as it was a god awful mess. permalink fedilink source parent
[–] StrawberryPigtails@discuss.tchncs.de 1 point 1 day ago My Hermes agent and OpenCode both can see the same Obsidian vault. I just started working with OpenCode and haven't quite figured it out, however my Hermes agent has learned that everything I work on needs a file in Obsidian and that if it needs to look something up that it should look through Obsidian first. Prompts usually tell them to "look in the vault" or "write up what we've been doing in the vault, suitable for another agent to understand what is going on with no prior context". It's not currently all that reliable, but I've only been working with Hermes for a few months and started playing with OpenCode a few weeks ago. I need to work a bit more on orginization, though. Last time I looked in there, I backed out quickly as it was a god awful mess. permalink fedilink source parent