I have a Framework Desktop that I want to put AI models on. I keep hearing that local models are getting more and more impressive. I would love to one day get off of my Claude dependence for the sake of privacy and running things in house.
I am currently trying out using pi agent with GLM-4.7-Flash Q8_0.
I don't have much of a reference to say how it compares to other local models, but it's definitely not something I could switch over to as a main driver instead of Claude.
What are you guys thoughts?
This is also the first time I've tried Pi. I've also been recommended hermes, which I know very little about.
▗▄▄▄ ▗▄▄▄▄ ▄▄▄▖ root@nixos
▜███▙ ▜███▙ ▟███▛ ------------
▜███▙ ▜███▙▟███▛ OS: NixOS 26.05 (Yarara) x86_64
▜███▙ ▜██████▛ Host: Desktop (AMD Ryzen AI Max)
▟█████████████████▙ ▜████▛ ▟▙ Kernel: Linux 6.18.44
▟███████████████████▙ ▜███▙ ▟██▙ Uptime: 11 days, 21 hours, 26 ms
▄▄▄▄▖ ▜███▙ ▟███▛ Packages: 500 (nix-system)
▟███▛ ▜██▛ ▟███▛ Shell: bash 5.3.9
▟███▛ ▜▛ ▟███▛ Terminal: /dev/pts/7
▟███████████▛ ▟██████████▙ CPU: AMD RYZEN AI MAX+ 395 (32)z
▜██████████▛ ▟███████████▛ GPU: AMD Radeon 8060S Graphics ]
▟███▛ ▟▙ ▟███▛ Memory: 39.81 GiB / 125.09 GiB )
▟███▛ ▟██▙ ▟███▛ Swap: 6.73 MiB / 7.45 GiB (0%)
▟███▛ ▜███▙ ▝▀▀▀▀ Disk (/): 119.94 GiB / 3.57 TiB4
▜██▛ ▜███▙ ▜██████████████████▛ Local IP (enp191s0): 192.168.0.4
▜▛ ▟████▙ ▜████████████████▛ Locale: en_US.UTF-8
▟██████▙ ▜███▙
▟███▛▜███▙ ▜███▙
▟███▛ ▜███▙ ▜███▙
▝▀▀▀ ▀▀▀▀▘ ▀▀▀▘
I wish that were true but I don't know that it's the case. People need something that gives them utility. It seems like everyone is oversaturated these days trying to reconcile the evil that's being illuminated around the world. I understand the intention, I just don't think it's ultimately effective.