padreug

joined 1 year ago
[–] padreug@programming.dev 1 points 1 day ago

I wish that were true but I don't know that it's the case. People need something that gives them utility. It seems like everyone is oversaturated these days trying to reconcile the evil that's being illuminated around the world. I understand the intention, I just don't think it's ultimately effective.

[–] padreug@programming.dev 1 points 1 day ago

it's an open source repo: https://github.com/omacom/omarchy I know it's essentially just a bunch of config files, but is this not the thing everyone is wanting to fight against?

[–] padreug@programming.dev -1 points 3 days ago* (last edited 3 days ago) (2 children)

but I'm honestly curious, what is this movement against him going to accomplish? I do not know this DHH character nor do I care to listen to anything he says. If he's as bad as all of these accusations make him out to be then he's someone who's just going to write off all of this and/or it'll fuel him.

I'm genuinely curious, what is the real value or impact of this crusade versus putting that energy toward something constructive? While everyone here is writing about fascism, him and capitalism will keep developing.

It's just all sounds like terribly futile tactics...

I had originally linked it, but damn! to be honest i want to have nothing to do with whatever is going on here and I'm just going to keep building stuff toward open-source decentralized future using whatever tools I have at my disposal to close the distance. I'm no trained software developer (learned C++ and python from mech engineering & physics) that can reliably maintain a repo people might depend on and this just seems like people flinging shit around. Noooo thank you

[–] padreug@programming.dev -2 points 3 days ago* (last edited 3 days ago)

but I’m honestly curious, what is this movement against him going to accomplish? I do not know this DHH character nor do I care to listen to anything he says. If he’s as bad as all of these accusations make him out to be then he’s someone who’s just going to write off all of this and/or it’ll fuel him. I’m genuinely curious, what is the real value or impact of this crusade versus putting that energy toward something constructive? While everyone here is writing about fascism, him and capitalism will keep developing. It’s just all sounds like terribly futile tactics…

[–] padreug@programming.dev -2 points 3 days ago* (last edited 3 days ago) (8 children)

Voicing again my agreement, all of this energy going against DHH could be put into a fork and that would be way more powerful and effective of a move.

It's got kind of a tai chi element - move in the direction of the vector don't try to go against it. It's popular for a reason, and you don't have to throw the baby out with the bath water. There are many things today that you could hyperfocus on the evil aspect of that people still use in their daily lives because it brings them utility.

I used Omarchy and it inspired me to make a NixOS version of it that I called Omnixient :) Thanks to the open-source nature I now have my own awesome config that has brought me a lot of fulfillment and productivity I did not have before.

[–] padreug@programming.dev 4 points 5 days ago (4 children)

what do people think of Netbird?

[–] padreug@programming.dev 2 points 1 week ago

I am brand new to Pi as of this week, so far my evolution in the past years went from... Visual Studio (oh wow it'd been so long i've forgotten the name 🤣).... then Cursor... then Claude Code. I tried a few neovim integrated AI workflows over a year ago, but they were all too buggy.

I caught wind of Pi I think from the youtuber omerxx and decided to give it a spin cause of its claims to be highly customizable. I haven't had the same time I did in the past to really tinker with my setups, but I figure i'll do it in baby steps over time.

[–] padreug@programming.dev 2 points 1 week ago

Thanks for the info, it's totally welcomed - I am trying my best to learn by sponge mode 🧽 😄

Yeah, I had not considered using one of those middle grounds and will check them out 🙏

[–] padreug@programming.dev 2 points 1 week ago (2 children)

Great, thanks for the info! How do you like hermes, have you tried out pi?

[–] padreug@programming.dev 1 points 1 week ago

Did you give Qwen3.8-27B-FP8 a try?

I haven't, it seems like I can't do this with my current Vulkan setup, but I'll do some exploration.

I'm also waiting for the nixos support for glm 5.3 flash

[–] padreug@programming.dev 1 points 1 week ago

Hey! thanks for the reply :) yeah the slowing down part is a big factor.. i'm certainly being a little impatient, so well received 🙏😁
I had also noticed I had a big mismatch in my pi models.json's contextWindow and maxTokens, which I just fixed (shown in another comment) so going to test it out some more.

[–] padreug@programming.dev 1 points 1 week ago* (last edited 1 week ago)

Hey, thanks for the reply, the speed is actually pretty good!

So it's running on llama.cpp (llama-server) b10408, Vulkan/RADV, behind llama-swap.

Your questions made me realize i also had a mismatch in my pi model config, the contextWindow and maxTokens had drifted apart pretty significantly so I just fixed that now.

/etc/nixos/configuration.nix

  services.llama-swap = {
    enable = true;
    package = pkgs.llama-swap;
    listenAddress = "0.0.0.0";
    port = 8080;
    openFirewall = true;

    settings = {
      # 63 GB off NVMe cold is slow. The default 120s will time out.
      healthCheckTimeout = 600;
      logLevel = "info";

      models = {
        "glm-flash" = {
          # Keep "local" as an alias so existing clients keep working
          # without touching their base URL or model name.
          aliases = [ "local" "fast" ];
          ttl = 1800;
          cmd = ''
            ${lib.getExe' pkgs.llama-cpp-vulkan "llama-server"}
            --port ''${PORT}
            -m /srv/llm/models/GLM-4.7-Flash-Q8_0.gguf
            -ngl 999 --flash-attn on -c 131072 -np 1
            --jinja --no-webui
            --reasoning-format auto --reasoning-preserve
            --temp 1.0 --top-p 0.95 --repeat-penalty 1.0
            --cors-origins "http://optimus.local:8080,http://localhost:8080/"
          '';
        };

        "gpt-oss-120b" = {
          aliases = [ "smart" ];
          ttl = 1800;
          cmd = ''
            ${lib.getExe' pkgs.llama-cpp-vulkan "llama-server"}
            --port ''${PORT}
            -m /srv/llm/models/gpt-oss-120b/gpt-oss-120b-MXFP4.gguf
            -ngl 999 --flash-attn on -c 65536 -np 1
            --jinja --no-webui --reasoning-format auto
            --temp 1.0 --top-p 1.0 --top-k 0 --min-p 0.0
            --cors-origins "http://optimus.local:8080,http://localhost:8080/"
          '';
        };
      };
    };
  };

~/.pi/agent/models.json (fixed)

{
  "providers": {
    "optimus": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "ollama",
      "models": [
        {
          "id": "local",
          "name": "GLM-4.7-Flash Q8_0 (optimus)",
          "aliases": ["fast", "glm-flash"],
          "reasoning": true,
          "contextWindow": 131072,
          "maxTokens": 32768,
          "cost": { "input": 0, "output": 0, "cacheRead": 0, "cacheWrite": 0 }
        },
        {
          "id": "smart",
          "name": "GPT-OSS-120B (optimus)",
          "aliases": ["gpt-oss-120b", "oss"],
          "reasoning": true,
          "contextWindow": 65536,
          "maxTokens": 16384,
          "cost": { "input": 0, "output": 0, "cacheRead": 0, "cacheWrite": 0 }
        }
      ]
    }
  }
}
 

I have a Framework Desktop that I want to put AI models on. I keep hearing that local models are getting more and more impressive. I would love to one day get off of my Claude dependence for the sake of privacy and running things in house. I am currently trying out using pi agent with GLM-4.7-Flash Q8_0. I don't have much of a reference to say how it compares to other local models, but it's definitely not something I could switch over to as a main driver instead of Claude.

What are you guys thoughts?

This is also the first time I've tried Pi. I've also been recommended hermes, which I know very little about.

          ▗▄▄▄       ▗▄▄▄▄    ▄▄▄▖             root@nixos
          ▜███▙       ▜███▙  ▟███▛             ------------
           ▜███▙       ▜███▙▟███▛              OS: NixOS 26.05 (Yarara) x86_64
            ▜███▙       ▜██████▛               Host: Desktop (AMD Ryzen AI Max)
     ▟█████████████████▙ ▜████▛     ▟▙         Kernel: Linux 6.18.44
    ▟███████████████████▙ ▜███▙    ▟██▙        Uptime: 11 days, 21 hours, 26 ms
           ▄▄▄▄▖           ▜███▙  ▟███▛        Packages: 500 (nix-system)
          ▟███▛             ▜██▛ ▟███▛         Shell: bash 5.3.9
         ▟███▛               ▜▛ ▟███▛          Terminal: /dev/pts/7
▟███████████▛                  ▟██████████▙    CPU: AMD RYZEN AI MAX+ 395 (32)z
▜██████████▛                  ▟███████████▛    GPU: AMD Radeon 8060S Graphics ]
      ▟███▛ ▟▙               ▟███▛             Memory: 39.81 GiB / 125.09 GiB )
     ▟███▛ ▟██▙             ▟███▛              Swap: 6.73 MiB / 7.45 GiB (0%)
    ▟███▛  ▜███▙           ▝▀▀▀▀               Disk (/): 119.94 GiB / 3.57 TiB4
    ▜██▛    ▜███▙ ▜██████████████████▛         Local IP (enp191s0): 192.168.0.4
     ▜▛     ▟████▙ ▜████████████████▛          Locale: en_US.UTF-8
           ▟██████▙         ▜███▙
          ▟███▛▜███▙         ▜███▙
         ▟███▛  ▜███▙         ▜███▙
         ▝▀▀▀    ▀▀▀▀▘         ▀▀▀▘
view more: next ›