https://www.todayintabs.com/p/eternal-black-october
The problem with A.I. defense is the same asymmetry attackers have always had against defenders. After a hotel bombing in Brighton, England in October, 1984 that failed to kill Margaret Thatcher, the Irish Republican Army put out a statement that said “Today, we were unlucky. But remember we have only to be lucky once. You will have to be lucky always.“ As it turned out, Margaret Thatcher was lucky always, but there’s no reason to believe the rest of us will be. If an A.I. hack attempt works one time out of a thousand, that’s a fantastic success rate. If your A.I. sysop “secures” your server by deleting the production database and all the backups one time out of a thousand… well. Who’s gonna be first to sign up for those odds? Roll the dice! Apparently they always come up four.