490
The DOJ is using fake "AI" case citations to justify ICE detainment (europe.pub)
submitted 3 months ago* (last edited 3 months ago) by to c/fuck_ai@lemmy.world
45 comments fedilink hide all child comments
 

cross-posted from: https://infosec.pub/post/49593520

Source

https://storage.courtlistener.com/recap/gov.uscourts.miwd.120609/gov.uscourts.miwd.120609.11.0.pdf

you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 3 months ago* (2 children)

And I'm saying that lying is inherent to the technology. Generative AI uses probability to generate output. It's constantly rolling dice when determining output. Any data fed into it is used to calculate odds on what words should follow other words.

It's like making a smoothie and then trying to consume specific vitamins. No matter how good your smoothie making machine is, that's gonna be an impossible task because blending everything together is inherent to making a smoothie. You'd be much better served just eating individual bananas to get your potassium intake.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 3 months ago* (last edited 3 months ago) (1 child)

    And I agree with you. When you let an AI be creative it will lie. But if they are reading documents they generally don't. That information is now a part of their context and it will reuse that information. It's a good fuzzy search. It is however terrible at a lot of other things.

    Edit: it's like a plagerism machine! Which in this one case is probably good

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 3 months ago

    If you feed a chatbot the sentences, "Bananas are a good source of potassium. Bananas are not a good source of protein." There is a good chance it will spit out the phrase, "Bananas are a good source of protein." because the phrase "good source of protein" is in the original data it was fed. There will always be a significant chance of spitting out this phrase.

    No matter how much you improve the AI, because it uses probabilistic generation, it will always be cobbling together sentences without any regard for what the overall sentence means. An intern will eventually learn case law, an AI agent will never be trustworthy. When you ask an AI agent a question, it will always lie to you about being certain of its answer because its answer is built upon a roll of the dice.

  • permalink
  • fedilink
  • source
  • parent