DeepSeek V4 flash is feasiblish to run it personally. A minipc costing $3000 can do a working quantization, two such computers can run what is in practice a full model. You could even run a (weak but working) quantization of GLM5.2 in this configuration.

What you get running models this way is control over what exactly runs (you never know how aggresively quantized are models running with API, for example) and possibility of running anything that fits (e.g. models with refusals removed with methods like heretic).

What you lose is that you need to buy special hardware for thousands of dollars (which might or might not age well) and loading prompt (including the history of conversation) can be really slow compared to what bigger machines that host models for many users can achieve. Loading past context of 100,000s tokens takes actual minutes while using the same model through API will feel instant.

It shows how important is for people to own the datacenters. Running model on bigger hardware for multiple people is much more efficient than running it on personal hardware.