Yeah, it seems like a new type of judgement is needed that I don't normally encounter in a day. Like, I use a hammer to hammer nails, then I put it down. I don't try to cook with it. This tool has a weird, abstract nature to it where you can drift between using / misusing / abusing without necessarily noticing. A strange position to be in while trying to work at the same time .

For corporate software, there's so many bugfixes and features, which require so few additions/changes that it's faster to do it than to write the prompt.

But obviously only if you're able to hold the entire codebase in your skull, but a proficient developer should be able to do so.

If people begin outsourcing these changes to LLMs, then they're cooked and no longer able to verify the output.