Damn I try to keep my mouth shut but if someone screamed that near me I'd be interjecting. Like goddamnit the AI does not know anything.
It's a machine modeling human speech. It's all a hallucination and sometimes that hallucination is straight up lies and sometimes, hopefully most of the time, it aligns with actual reality.
I fucking loathe that people won't take 15 minutes to just read a basic primer on what an LLM is. It's a fancy autocorrect, and yeah it's way more complex than that but at the end of a day it's made to model realistic human language output - and that's it. It doesn't have any actual knowledge, it doesn't have any way to know if what it says is true or not, and it certainly doesn't know if what it says is insane.