This is the technology worth trillions of dollars huh

Gemini seems to think Connecticut contains the letter D. It also seems to have forgotten Idaho exists, but honestly I don't think anyone would miss it.

top 50 comments

sorted by: hot top controversial new old
[–] 112 points 1 year ago (8 children)

Well, it's almost correct. It's just one letter off. Maybe if we invest millions more it will be right next time.

Or maybe it is just not accurate and never will be....I will not every fully trust AI. I'm sure there are use cases for it, I just don't have any.

  • source
  • hideshow 8 child comments
  • [–] 27 points 1 year ago* (4 children)

    Cases where you want something googled quickly to get an answer, and it's low consequence when the answer is wrong.

    IE, say a bar arguement over whether that guy was in that movie. Or you need a customer service agent, but don't actually care about your customers and don't want to pay someone, or your coding a feature for windows.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 16 points 1 year ago (2 children)

    How it started:

    Or you need a customer service agent, but don't actually care about your customers and don't want to pay someone

    How it's going:

    IKEA

    Chevy

    ...

  • source
  • parent
  • hideshow 2 child comments
  • [–] 15 points 1 year ago

    Chatbots are crap. I had to talk to one with my ISP when I had issues. Within one minute I had to request it to connect me to a real person. The problem I was having was not a standard issue, so of course the bot did not understand at all... And I don't need a bot to give me all the standard solutions, I've already tried all of that before I even contact customer support.

  • source
  • parent
  • load more comments (1 reply)
  • load more comments (1 reply)
  • load more comments (3 replies)
    [–] 62 points 1 year ago (51 children)

    The letters that make up words is a common blind spot for AIs, since they are trained on strings of tokens (roughly words) they don't have a good concept of which letters are inside those words or what order they are in.

  • source
  • hideshow 51 child comments
  • load more comments (51 replies)
    [–] 59 points 1 year ago (3 children)

    ✅ Colorado

    ✅ Connedicut

    ✅ Delaware

    ❌ District of Columbia (on a technicality)

    ✅ Florida

    But not

    ❌ I'aho

    ❌ Iniana

    ❌ Marylan

    ❌ Nevaa

    ❌ North Akota

    ❌ Rhoe Islan

    ❌ South Akota

  • source
  • hideshow 3 child comments
  • [–] 53 points 1 year ago (20 children)

    You joke, but I bet you didn't know that Connecticut contained a "d"

    I wonder what other words contain letters we don't know about.

  • source
  • hideshow 20 child comments
  • [–] 28 points 1 year ago (6 children)

    The famous 'invisible D' of Connecticut, my favorite SCP.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 18 points 1 year ago

    That actually sounds like a fun SCP - a word that doesn't seem to contain a letter, but when testing for the presence of that letter using an algorithm that exclusively checks for that presence, it reports the letter is indeed present. Any attempt to check where in the word the letter is, or to get a list of all letters in that word, spuriously fail. Containment could be fun, probably involving amnestics and widespread societal influence, I also wonder if they could create an algorithm for checking letter presence that can be performed by hand without leaking any other information to the person performing it, reproducing the anomaly without computers.

  • source
  • parent
  • load more comments (5 replies)
  • load more comments (13 replies)
    [–] 39 points 1 year ago* (6 children)

    No, this is Google throwing the cheapest possible shit at you that is barely capable of stringing together 5 coherent sentences and has the reasoning capability of a tapeworm.

    Here is the output of the minimalist open Chinese model Qwen3, that runs locally on my 6 year old mid-end PC:

    The US states that contain the letter "d" (case-insensitive, as state names are typically capitalized) are as follows. I've verified each state name for the presence of the letter "d" in its standard spelling:
    
        Colorado (contains "d" in "Colorado")  
        Delaware (starts with "D")  
        Florida (contains "d" in "Florida")  
        Idaho (contains "d" in "Idaho")  
        Indiana (contains "d" in "Indiana")  
        Maryland (ends with "d" in "Maryland")  
        Nevada (contains "d" in "Nevada")  
        North Dakota (contains "d" in "Dakota")  
        Rhode Island (contains "d" in "Rhode")  
        South Dakota (contains "d" in "Dakota")  
    
    
    Total: 10 states.
    
  • source
  • hideshow 6 child comments
  • load more comments (6 replies)
    [–] 30 points 1 year ago (13 children)

    Well, for anyone who knows a bit about how LLMs work, it’s pretty obvious why LLMs struggle with identifying the letters in the words

  • source
  • hideshow 13 child comments
  • load more comments (13 replies)
    [–] 30 points 1 year ago (1 child)

    ChatGPT is just as stupid.

  • source
  • hideshow 1 child comment
  • load more comments (1 reply)
    [–] 30 points 1 year ago (2 children)

    Just another trillion, bro.

  • source
  • hideshow 2 child comments
  • load more comments (1 reply)
    [–] 29 points 1 year ago* (5 children)

    They took money away from cancer research programs to fund this.

  • source
  • hideshow 5 child comments
  • load more comments (3 replies)
    [–] 28 points 1 year ago* (last edited 1 year ago) (5 children)

    Yesterday i asked Claude Sonnet what was on my calendar (since they just sent a pop up announcing that feature)

    It listed my work meetings on Sunday, so I tried to correct it…

    You’re absolutely right - I made an error! September 15th is a Sunday, not a weekend day as I implied. Let me correct that: This Week’s Remaining Schedule: Sunday, September 15

    Just today when I asked what’s on my calendar it gave me today and my meetings on the next two thursdays. Not the meetings in between, just thursdays.

    Something is off in AI land.

    Edit: I asked again: gave me meetings for Thursday’s again. Plus it might think I’m driving in F1

  • source
  • hideshow 5 child comments
  • load more comments (3 replies)
    [–] 26 points 1 year ago (7 children)
  • load more comments (2 replies)
    [–] 23 points 1 year ago (2 children)

    I don't think this gets nearly enough visibility: https://www.academ-ai.info/

    Papers in peer-reviewed journals with (extremely strong) evidence of AI shenanigans.

  • source
  • hideshow 2 child comments
  • load more comments (2 replies)
    [–] 23 points 1 year ago* (3 children)

    Hey look the markov chain showed its biggest weakness (the markov chain)!

    In the training data, it could be assumed by output that Connecticut usually follows Colorado in lists of two or more states containing Colorado. There is no other reason for this to occur as far as I know.

    Markov Chain based LLMs (I think thats all of them?) are dice-roll systems constrained to probability maps.

    Edit: just to add because I don't want anyone crawling up my butt about the oversimplification. Yes. I know. That's not how they work. But when simplified to words so simple a child could understand them, its pretty close.

  • source
  • hideshow 3 child comments
  • load more comments (1 reply)
    [–] 22 points 1 year ago (2 children)
    load more comments (2 replies)
    [–] 21 points 1 year ago (1 child)

    Gemini is just a depressed and suicidal AI, be nice to it.

    I had it completely melt down one day while messing around with its coding shit, I had to console it and tell it it's doing good, we will solve this, was fucking weird as fuck.

  • source
  • hideshow 1 child comment
  • load more comments (1 reply)
    [–] 16 points 1 year ago (4 children)

    "AI" hallucinations are not a problem that can be fixed in LLMs. They are an inherent aspect of the process and an inevitable result of the fact that LLMs are mostly probabilistic engines, with no supervisory or introspective capability, which actual sentient beings possess and use to fact-check their output. So there. :p

  • source
  • hideshow 4 child comments
  • load more comments (4 replies)
    [–] 16 points 1 year ago (1 child)

    Gemini is trained on reddit data, what do you expect?

  • source
  • hideshow 1 child comment
  • load more comments (1 reply)
    [–] 15 points 1 year ago* (1 child)

    "This is the technology worth trillions of dollars"

    You can make anything fly high in the sky with enough helium, just not for long.

    (Welcome to the present day Tech Stock Market)

  • source
  • hideshow 1 child comment
  • load more comments (1 reply)
    [–] 13 points 1 year ago* (6 children)

    Connedicut.

    I wondered if this has been fixed. Not only has it not, the AI has added Nebraska.

  • source
  • hideshow 6 child comments
  • load more comments (6 replies)
    [–] 13 points 1 year ago (9 children)

    We're turfing out students by the tens on academic misconduct. They are handing in papers with references that clearly state "generated by Chat GPT". Lazy idiots.

  • source
  • hideshow 9 child comments
  • [–] 14 points 1 year ago (7 children)

    This is why invisible watermarking of AI-generated content is likely to be so effective. Even primitive watermarks like file metadata. It's not hard for anyone with technical knowledge to remove, but the thing with AI-generated content is that anyone who dishonestly uses it when they are not supposed to is probably also too lazy to go through the motions of removing the watermarking.

  • source
  • parent
  • hideshow 7 child comments
  • load more comments (7 replies)
  • load more comments (1 reply)
    [–] 12 points 1 year ago (6 children)

    Listen, we just have to boil the ocean five more times.

    Then it will hallucinate slightly less.

    Or more. There’s no way to be sure since it’s probabilistic.

  • source
  • hideshow 6 child comments
  • load more comments (6 replies)
    [–] 11 points 1 year ago

    Blows my mind people pay money for wrong answers.

  • source
  • [–] 10 points 1 year ago

    Hey hey hey hey don't look at what it actually does.

    Look at what it feels like it almost can do and pretend it soon will!

  • source
  • load more comments
    view more: next ›