That's literally how the work: They can't reason or think. They don't know or understand anything. They just output strings of words that are statistically likely to be the response to your question based on strings of words that they've been trained on.

Why are you wasting you time with AI anything? It's all shit.

Yeah; just goes to show they really don't "think" or "understand" like we do.

LLMs don't really know the subject matter they talk about in the same way a person does. Whatever you feed as input biases the responses towards and away from certain sequences of words. If you put in something about Star Wars, it'll weigh its output in favor of saying things like "Luke Skywalker" and "Darth Vader" and away from things like "The best way to use a crockpot is...". When you're trying to get it to recall facts about things that aren't extremely famous, it will jumble some parts or just make things up that sound plausible.

As an example, I liked to prompt them with "Tell me about 'A Valiant Effort (1989)'" as a test -- it doesn't actually exist, but they'd often tell me it was a painting or a movie or an obscure book with hallucinated details until very recently; newer models seem more likely to say "I don't know what that is" or similar, but that's not guaranteed.

To get better results, try feeding it a passage you'd like it to work on directly in the input instead of assuming it just knows the story already, and you'll get output weighted by the actual text (and whatever else you put in context).

You run out of people to talk to or what?

i am guessing you arr using the free versions but i can imagine this type of thing is more open to hallucinations. so taking, replayjng text coupled with free model. wont be the best.

are you able to attach the book to your chat inn the free version? do you have a digital copy?

Did the AI “fail,” or did you use AI in a suboptimal way?

If you had started the conversation by feeding in the actual text of the book, you would have very different results, because you would be grounding on context rather than asking the model to “figure it out somehow” based on training data.

Not sure what you were expecting, using AI is mostly about context management, and if you don’t set up the context correctly you’re asking for results similar to this.