The important thing to keep in mind is that we are not currently at risk of anyone inventing a super intelligence. The word guessing engines are getting amazingly good at guessing words, but the huge jump from that to actual intelligence, super or otherwise, remains out of reach with currently known technology.
I agree that if we did manage to invent that, the biggest threat would be the humans doing short-sighted, greedy and generally stupid shit with it. No coincidence that that's also the biggest threat from current LLMs.
Edit: "Super-hammers could break containment and kill us all if we don't invest more in controlling them!" shouts man wildly swinging around a hammer in a crowded room. "The government needs to regulate this technology so that only people like me, who use it responsibly, can have access to it," he added. He tried to say more, but was out of breath after some particularly enthusiastic hammer swings.