What just happened? Another incident has taken place that illustrates the need to be careful what you tell AI. A Florida woman is facing felony charges after she used Claude as a diary and allegedly wrote that she planned to "shoot up" the Sheriff's office. After a human reviewer examined the statements, they were reported to police.

According to the arrest report, Carli Michelle Heller, of Bonita Springs, Florida, wrote on September 26 that she would attack the Sheriff's office. She later said that she uses Anthropic's chatbot like a "diary."

Claude's safety systems flagged the entry and it was escalated to a human reviewer. After deciding it was a credible threat, the reviewer reported it to law enforcement.

The company says it may share user information in limited emergencies if it believes disclosure is necessary to prevent death or serious physical injury.

Deputies identified Heller and visited her home. She was detained without incident before an LCSO intelligence detective took over the investigation.

Heller faces a charge of making a written threat of violence under Florida law. Florida Statute 836.10 makes it a second-degree felony to send, post, or transmit a written or electronic record threatening to kill or injure someone, carry out a mass shooting, or commit an act of terrorism. The communication must be made in a manner in which another person may view it.

Anthropic isn't going to be taking any chances when it comes to anything it deems a potential threat. Last month, it was reported that OpenAI and Sam Altman are being sued by British Columbia over claims that the company could have prevented a mass shooting in the Canadian province.

The shooter, eighteen-year-old former pupil Jesse Van ⁠Rootselaar, had previously been flagged by OpenAI's safety team for her conversations about gun violence, but OpenAI never alerted police because the conversations did not meet the threshold for legal referral.

In June, Florida also sued OpenAI and Altman, alleging that ChatGPT had contributed to real-world harms, including the 2025 Florida State University shooting.

The latest incident is another reminder to think before you enter something into a chatbot that could get you into trouble. It's certainly not a private diary whose contents are for your eyes only.

Reports last month revealed that human contractors reviewing Microsoft Copilot's image editor can see users' prompts, uploaded photos and AI-generated edits. Documents show that some of those assignments contain sexual, disturbing or potentially illegal material, though the reviewers are not there to flag the content – only to assess whether the output is accurate.

top 50 comments

sorted by: hot top controversial new old
[–] 6 points 1 day ago

Florida Statute 836.10 makes it a second-degree felony to send, post, or transmit a written or electronic record threatening to kill or injure someone, carry out a mass shooting, or commit an act of terrorism.

She wrote out in a means she thought was private. If using a paperback diary, no one would be the wiser and her not acting on it would never be noticed.

Anyway, if she gets a good lawyer, show me where she "sent, posted or transmitted" said electronic record! It's really no different than emailing that to yourself because you think you'll be the only person to see it. (Never mind companies scan your email and cloud too)

  • source
  • [–] 5 points 1 day ago*

    Telling the wire tap all your secrets, and expecting it to honor them?! is fucking next level delusional.

  • source
  • [–] 21 points 1 day ago (5 children)

    Kinda unrelated. But what happens when OpenAI or Anthropic's loans come due and they have no legal way to turn a profit, but are sitting on a treasure trove of corporate secrets?

  • source
  • hideshow 5 child comments
  • [–] 5 points 1 day ago (1 child)

    Are they sitting on a treasure trove of corporate secrets? Or is it just a thousand executives writing "Claude, synergize expediency to increase value for shareholders. Maximize usefulness. Implement Six Cigma methodologies to unlock a more agile work cycle. Generate a billion dollars in new cashflow. Make no mistakes."

  • source
  • parent
  • hideshow 1 child comment
  • [–] 6 points 1 day ago

    Don't use "AI" for anything you wouldn't mind seeing plastered all over the Internet. You wouldn't tell a human being that you were planning to "shoot up a sheriff's office" would you? Why would an AI keep that a secret?

  • source
  • [–] 44 points 2 days ago (1 child)

    I find it interesting that, if their AI gets out of control, there's nothing they can do about it, but if a USER of that AI gets out of control, there is something they can do about it..

  • source
  • hideshow 1 child comment
  • [–] 34 points 1 day ago (4 children)

    Why would you even use Claude as a fuckin diary?

  • source
  • hideshow 4 child comments
  • load more comments (3 replies)
    [–] 9 points 1 day ago

    AI and idiots go together like peanut butter and jelly.

  • source
  • [–] 13 points 1 day ago (7 children)

    Americans doing anything but proper gun control

  • source
  • hideshow 7 child comments
  • load more comments (6 replies)
    [–] 27 points 2 days ago (16 children)

    Self host if you're gonna use AI, in fact, self host whenever possible. There are numerous examples of companies using centralized data to sell, report to police, or even having it fall into the hands of hackers.

    I really think people think that all data input to a website is actually stored locally, nope, don't be dumb.

  • source
  • hideshow 16 child comments
  • load more comments (7 replies)
    [–] 227 points 2 days ago (32 children)

    And people were not-so-long-ago concerned that phones are spying after them. Now they just send all the info themselves.

  • source
  • hideshow 32 child comments
  • [–] 208 points 2 days ago (17 children)
  • [–] 52 points 2 days ago (8 children)

    Up until the 80s, there was still some debate over whether wiretaps should be legal. It's sad that we have come to accept them as normal.

  • source
  • parent
  • hideshow 8 child comments
  • load more comments (2 replies)
  • load more comments (8 replies)
  • load more comments (14 replies)
    [–] 7 points 1 day ago (1 child)

    Who would use AI to write down dairy entries? Was she looking for feedback?

  • source
  • hideshow 1 child comment
  • In my school district, kids kept getting called to the office because of what they wrote in Google Docs and their search queries. Sexual reproductive scientific research was also impossible to do

  • source
  • [–] 62 points 2 days ago (8 children)

    It's always interesting to see how much people trust sending such personal information to some service on the Internet, expecting privacy.

    I'm not sure I'd even want my own self-hosted LLMs to have something like a personal diary. Sending all that to an AI company would never even cross my mind.

    I understand that most people aren't the tech-oriented types who get into self-hosting and running their own LLMs, but people have had diaries for centuries before LLMs existed.

  • source
  • hideshow 8 child comments
  • load more comments (8 replies)
    [–] 100 points 2 days ago (6 children)

    "The company says it may share user information in limited emergencies if it believes disclosure is necessary to prevent death or serious physical injury."

    Also keep in mind: Your chat logs are company assets. Even if today's decision makers believe maintaining user trust is net profitable, that will not always be true. Some day, maybe when the pullback comes and the wolves are at the gates, or when they sell the company, or when a shareholder action asserts fiduciary duty to maximize shareholder value, your chat logs will be sold and mined in the most lucrative way possible. The way that extracts the most value from you, the product.

  • source
  • hideshow 6 child comments
  • load more comments (6 replies)
    [–] 78 points 2 days ago (5 children)

    The communication must be made in a manner in which another person may view it.

    So she shouldn't even get charged.

  • source
  • hideshow 5 child comments
  • load more comments (5 replies)
    [–] 27 points 2 days ago (3 children)

    Florida Statute 836.10 makes it a second-degree felony to send, post, or transmit a written or electronic record threatening to kill or injure someone

    This means a significant portion of Lemmy (and the rest of the internet) are criminals evading justice

    great law top shelf

  • source
  • hideshow 3 child comments
  • load more comments (3 replies)
    [–] 12 points 2 days ago* (6 children)

    The communication must be made in a manner in which another person may view it.

    So, their entire argument hinges on someone from Anthropic manually reviewing EVERY ""private"" message someone sends to Claude? Them false charges.

  • source
  • hideshow 6 child comments
  • load more comments (6 replies)
    [–] 45 points 2 days ago

    After a human reviewer examined the statements, they were reported to police.

    The guardrails are working as intended. ONLY persecute the public with them. Government skynet, and bond villains will have access to non guardrailed models, or any "flagged for review" markers will be ignored to bomb more elementary schools. A sheriff's office is government power related. School shootings is just a thoughts and prayers issue, if you're confused about the line between this and other incidents/attitudes we are being spied on for.

  • source
  • [–] 22 points 2 days ago

    Hell yeah. Thought crime. Time to get Tom Cruise in here to Minority Report all of us.

  • source
  • [–] 17 points 2 days ago (6 children)

    While a chatbot has been demonstrated not to be a private diary, it will be interesting to see if the courts agree that she intentionally use her diary to communicate or thought that someone else would read it. Like most users of dear diary she probably thought her secrets were safe and her diary would never tell.

  • source
  • hideshow 6 child comments
  • load more comments (6 replies)
    load more comments
    view more: next ›