I don't think people should be allowed to, and I never said as much.
The bad things being done are being done -with- AI, not because of it. My stance is one of accepting that it's a thing that exists in the world and it will not go away. Any energy you put into erasing it is going to be wasted. It's here.
The humans gatekeeping the AI are the problem, not the AI.
The fact that most of humanity has given our inherent power to money, and that money (in the hands of the few) controls the world is another problem.
The absolute best thing we can do as individuals is embrace AI. The more you understand it, the more influence you will have over the path it takes, but it will not go away without some global extinction level event.