▲ 1280 ▼ Claude-powered AI coding agent deletes entire company database in 9 seconds — backups zapped, after Cursor tool powered by Anthropic's Claude goes rogue (www.tomshardware.com) submitted 5 months ago by throws_lemy@reddthat.com to c/technology@lemmy.world 343 comments fedilink hide all child comments
[–] percent@infosec.pub 3 points 5 months ago (1 child) These protocols predate LLMs permalink fedilink source parent hideshow 1 child comment replies: [–] EncryptKeeper@lemmy.world 2 points 5 months ago Yes that’s right the protocols that we humans used to have for giving only trusted, reliable people this level of access over infrastructure predate LLMs and were a great way to stop this from happening. However the AI is here now, and when you give an autonomous agent with known hallucination problems access to act on your behalf with your IaC on your infra provider, this kind of thing is an inevitability. permalink fedilink source parent
[–] EncryptKeeper@lemmy.world 2 points 5 months ago Yes that’s right the protocols that we humans used to have for giving only trusted, reliable people this level of access over infrastructure predate LLMs and were a great way to stop this from happening. However the AI is here now, and when you give an autonomous agent with known hallucination problems access to act on your behalf with your IaC on your infra provider, this kind of thing is an inevitability. permalink fedilink source parent