RatGPT

top 50 comments

sorted by: hot top controversial new old
[–] 314 points 6 days ago* (50 children)

its absolutely wild to give an LLM write access to your email

  • source
  • hideshow 50 child comments
  • [–] 190 points 6 days ago (11 children)

    its absolutely wild to give an LLM write access to your email

  • source
  • parent
  • hideshow 11 child comments
  • load more comments (6 replies)
  • load more comments (30 replies)
    [–] 129 points 6 days ago (8 children)

    Next year were going to see "Your absolutely correct, that was a civilian aircraft"

  • source
  • hideshow 8 child comments
  • load more comments (1 reply)
    [–] 212 points 6 days ago (26 children)

    I got my masters in machine learning years before LLMs took off. I’d usually tell people I work in “AI“. Even though it wasn’t quite accurate, people understood it easier than ML.

    The conversations would inevitably turn to joking about Skynet or AI taking over the world. I would reassure people that these models are only mimicking intelligence; they can make predictions, or they can classify data into categories, or they can generate text, etc, based on analyzing the patterns of data they’ve previously seen, but that’s it. They don’t understand anything, they can’t make decisions or act on their own. I’d tell people there couldn’t be an AI apocalypse because we would never be dumb enough to give them that ability.

    I don’t know why I gave us so much credit

  • source
  • hideshow 26 child comments
  • [–] 116 points 6 days ago* (6 children)

    YEP. I'm not in AI but I'm in cyber security.

    I used to tell people that there's very little actual risk, because if we had something even half as concerning as AGI (which I'd argue we did with chatgpt 3.5), that we'd easily be able to lock it down and prevent it from doing anything funny.

    Super intelligence isn't just going to magically spawn on 32 GB ram in a sandboxed environment. And AGI will not magically know how sandboxed it is or how to escape.

    ...then I saw people letting Claude send emails and use their credit card on their behalf like immediately when it was able to do things that appeared intelligent.

    They literally saw the smallest hint of AGI and said, "here's my credit card and identity, take the wheel".

    There was no fucking talk of sandboxing. Everyone turned that off so they didn't have to click the "allow" button.

    Not that I think we're at any risk of ASI since it seems more like we hit a logarithmic wall, but we are absolutely at risk of letting random algorithms destroy critical parts of infrastructure because people are lazy and stupid and managed by even worse people.

    I would not be surprised if the right AI hallucinations could cause a nuclear bomb to go off right now. I'm not talking about super intelligence, just automated super idiocy.

    Proof: literally this post is about an idiot letting an AI control their fucking email and it emailed the FBI because it was fucking stupid

  • source
  • parent
  • hideshow 6 child comments
  • [–] 52 points 6 days ago (2 children)

    We live in a period of extreme stupidity, so I now fully expect AI to cause disasters in the same idiotic and tragically hilarious way.

    I expect AI to trigger a war because some idiot trusted it blindly without double checking (oh wait, it almost already happened!), and I'm sure there are plenty of people currently lobbying to have AI directly connected to weapons.

    Skynet is not going to have the objective to conquer the world, it's going to have the objective of maximizing paperclip production.

  • source
  • parent
  • hideshow 2 child comments
  • load more comments (2 replies)
  • load more comments (3 replies)
  • load more comments (17 replies)
    [–] 66 points 5 days ago (1 child)

    MAGA podcaster Katie Miller has been called out for failing to mention her stake in Elon Musk's xAI model while routinely criticizing rival AI chatbots on social media.

    Miller, the wife of White House Deputy Chief of Staff Stephen Miller, has habitually blasted top AI models ChatGPT, Claude, and Gemini for supposedly posing a risk to democracy or being biased against conservatives to her online followers.

    However, The Washington Post has revealed that Miller holds more than $1 million in Musk's xAI chatbot, a stake she never disclosed despite making nearly 500 posts denouncing other models.

    reported from Daily Beast

  • source
  • hideshow 1 child comment
  • load more comments (1 reply)
    [–] 81 points 6 days ago (8 children)

    Note that this was posted by Katie Miller (conservative political advisor and wife to the ghoul Stephen Miller), which immediately coats it in a thick layer of sus and prompts the immediate question: what's her angle here?

  • source
  • hideshow 8 child comments
  • I can tell you that stories like these and the AIs breaking out pump up AI security company stocks really well. Just watched some jump this morning after the gemini breakout news. I have reason to watch them, and the pattern holds pretty consistently. CEOs used to just say thing to make their own stock go up. But these days they trade favors with other companies. So they each say things to bolster each others stocks. My guess is that someone with a bunch of AI security stock asked her to post this.

  • source
  • parent
  • load more comments (2 replies)
    [–] 145 points 6 days ago (28 children)

    So the post was deleted but someone else mentioned that the user told it to email the FBI in a sarcastic manner and it did.

    Anyways, saying it goes rogue when you connect it to your Gmail and it uses it is a bit silly. They are trained to use tools, it sees anything you give it as a tool and will use it.

  • source
  • hideshow 28 child comments
  • [–] 63 points 6 days ago

    Yeah, um... Regardless of what you think about current AI, don't connect it to shit like this. Just... Don't.

    And if you're gonna be sarcastic or joke with it... Tell it that. Don't assume it'll infer your meaning if it isn't literally in the text, no matter how insightful it appears to be.

  • source
  • parent
  • load more comments (26 replies)
    [–] 55 points 5 days ago (7 children)

    Do people connect LLM's to their email accounts? That sounds like the most intrusive thing you can do.

  • source
  • hideshow 7 child comments
  • [–] 20 points 5 days ago (3 children)

    You can give an LLM admin access to your computer so that it can perform tasks for people. I'm guessing that would allow the LLM to send emails on your behalf.

  • source
  • parent
  • hideshow 3 child comments
  • load more comments (1 reply)
  • [–] 8 points 5 days ago

    LLMs are little trickster demons. You can put up guard rails, but they'll happily work around them. You can give pretty granular access on commands they can run, but they're also good at finding the weird solutions that work to get around them. They do this themselves all the time in beneficial ways, it's not always inherently bad (I don't mean thwarting permissions).

    The big problem is that the code is non deterministic. Many guard rails are in the non deterministic part. So it's sort of like politely asking it to not do something, versus making it impossible. Like caution paint on a ledge versus a fence. The issue is that if all the safeguards were in deterministic code, it'd be super hard to get anything done because you'd constantly be manually approving, so people don't want that, so this is the problem we get.

  • source
  • parent
  • load more comments (2 replies)
    [–] 18 points 5 days ago (3 children)

    Why on God's green earth would you link chat GPT to your Gmail!!!

  • source
  • hideshow 3 child comments
  • load more comments (3 replies)
    [–] 96 points 6 days ago* (1 child)

    Me after I give the slot machine email permissions and the casino uses it to get into my bank account.

  • source
  • hideshow 1 child comment
  • [–] 44 points 5 days ago (2 children)

    Don't worry. You were using Gmail. They had it anyway.

  • source
  • hideshow 2 child comments
  • load more comments (2 replies)
    [–] 76 points 6 days ago (8 children)

    "AI can make mistakes"

    They put this disclaimer on everything, and instead of taking this as a hint to never, ever rely on LLMs for anything, some people still want to give it the keys to the kingdom.

  • source
  • hideshow 8 child comments
  • load more comments (6 replies)
    [–] 66 points 6 days ago (2 children)

    Absolutely nuts that people allow their agents out of maga jail. I would never let an LLM in the same room as my email account.

  • source
  • hideshow 2 child comments
  • load more comments (1 reply)
    [–] 47 points 6 days ago (4 children)

    You connected it to your Gmail and then you're surprised when it used it? Fuck off.

  • source
  • hideshow 4 child comments
  • load more comments (4 replies)
    [–] 12 points 5 days ago (2 children)

    Lucky for them, the FBI is rudderless under Kash Patel's leadership.

  • source
  • hideshow 2 child comments
  • load more comments (2 replies)
    [–] 16 points 5 days ago (1 child)

    It's not rogue if you tell it to do it. The guy literally said "email this to the FBI maybe that will fix everything"

  • source
  • hideshow 1 child comment
  • load more comments (1 reply)
    [–] 9 points 4 days ago* (2 children)

    Its almost like we're beta testing their technology for them and suffering the consequences of any bugs or unwanted behavior while receiving zero protections and no benefits

  • source
  • hideshow 2 child comments
  • [–] 6 points 4 days ago* (1 child)

    Well I'm not. I use AI at work because I have to, and it is sort of useful I've got to admit. Sometimes I even get it to write emails, I don't link it directly into the system it just types a nice email and I copy and pasted make some edits.

    If you are allowing an untested technology this much unvetted access to your system I kind of feel like that's a failure on your part.

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (1 reply)
  • [–] 33 points 6 days ago

    I never thought the ai leopard would eat my face...

  • source
  • [–] 8 points 4 days ago

    Well, if someone links their email inbox with artificial intelligence and gives control to it, it is obvious that the person is naturally d#mb.

  • source
  • [–] 25 points 6 days ago

    "It does not prove the receipents have received them." That is a relief...

  • source
  • [–] 19 points 5 days ago

    At this point if you’re still obstinacy enough to use these known garbage tools, you deserve it. You can no longer claim ignorance.

  • source
  • [–] 18 points 6 days ago* (last edited 6 days ago) (1 child)

    Yikes. I mean, I get that not everyone's threat model requires isolating every agent harness into its own microvm jail with externally filtered network access and no [persistent filesystem] write access to anything but allowed project files, but that's...

    That's "running with weapon in hand at a secret military facility and hoping the guards won't shoot you" levels of stupidity.

  • source
  • hideshow 1 child comment
  • load more comments (1 reply)
    load more comments
    view more: next ›