Humans hallucinate. These things extrapolate tokens statistically. In average his tone of requests would be likely to lead to some murder story.
Nothing is wrong with the tech (except it doesn't seem very useful when you firmly know what it can't do), but everything is wrong with that tech being called artificial intelligence.
It's almost like calling polygraph "lies detector".