Yes, which has improved some tasks measurably. ~20% improvement on programming tasks, as a practical example. It has also improved tool use and agentic tasks, allowing the llm to plan ahead and adjust it's initial approach based on later parts.

Having the llm talk through the tasks allows it to improve or fix bad decisions taken early based on new realizations on later stages. Sort of like when a human thinks through how to do something.

Lul yes but no, but they are clearly better at many types of tasks.

So you want me to provide some evidence that it's getting smarter, but you can't provide any that it's getting worse other than anecdotal evidence?

What evidence would you accept?

I see. So AI for gathering the information to put into the accounting/tax software?

That's a more reasonable ask, but I wouldn't personally trust AI with that. I've done something similar in games where I take a picture of something on screen and ask AI to collect all the information from many similar pictures into a table. It's definitely good enough for gaming, but it makes mistakes often enough I wouldn't sign my name attesting to the truth of anything it produced, you know?