My prediction:
They'll quietly switch it to be enabled by default in 6 months, re-enable it on every major update, and hide the "disable permanently" toggle in a group policy or registry key.
But when you get infected they'll point to this statement and say it's your fault.

Every time I read about these "upgrades", I'm glad I ditched Windows on my personal computers.

I am guessing that the next version of Windows will require a valid credit card number while being set up. That way Copilot can purchase and install other Microsoft products for you automatically in order to complete tasks it thinks you assigned it. Your acceptance of the EULA will be all the justification they need.

And yet the CEO is surprised everyone finds it underwhelming

I mean, it's perfectly sound advice. Don't enable features you don't understand. There are already plenty of features in Windows that would be privacy or security problems if you enable them without understanding what they do or how to use them.

MS: We are not responsible if your computer tries to kill you if you enable AI.

User: Okay!?

MS: enables AI by default

as opposed to MS install thier proprietary spyware.