This is the technology worth trillions of dollars huh

Gemini seems to think Connecticut contains the letter D. It also seems to have forgotten Idaho exists, but honestly I don't think anyone would miss it.
you are viewing a single comment's thread
view the rest of the comments
[–] 7 points 1 year ago (1 child)

ct -> d is a not-uncommon OCR fuck up. Maybe that's the source of it's garbage data?

  • source
  • parent
  • hideshow 1 child comment
  • [–] 6 points 1 year ago* (last edited 1 year ago)

    No, LLMs produce the most statistically likely (in their training data) token to follow a certain list of tokens (there's nothing remotely resembling reasoning going on in there, it's pure hard statistics, with some error and randomness thrown in), and there are probably a lot more lists where Colorado is followed by Connecticut than ones where it's followed by Delaware, so they're obviously going to be more likely to produce the former.

    Moreover, there aren't going to be many texts listing the spelling of states (maybe transcripts of spelling bees?), so that information is unlikely to be in their training data, and they can't extrapolate because it's not really something they do and because they use words or parts of words as tokens, not letters, so they literally have no way of listing the letters of a word if said list is not in their training data (and, again, that's not something we tend to write, and if we did we wouldn't include d in Connecticut even if we were reading a misprint). Same with counting how many letters a word has, and stuff like that.

  • source
  • parent