OpenAI considered alerting Canadian police about school shooting suspect months ago
(www.theguardian.com)
I understand your point, but there are also legal ramifications and scary potential consequences should this have transpired.
For instance, do we want ICE to have access to data about user behaviour? They might already have that.
Who decides the bar of acceptable behaviour?