Rather than writing a program, it just codes and runs the code at the same time

Yeah, so there's been a lot of improvement very quickly over the last year in LLM agent's coding abilities.

If they continue to improve at an exponential improvement rate like they have been... maybe 5-10 years from now you might see such a "code and run" as you make the descriptions LLM performance, for simpler things.

I'm curious, with "unlimited access" to the inference engine hardware capabilities, just how much faster the LLM agents can run when they're not in timeshare over the internet mode?