233
Anthropic bans ‘abusive or cruel behavior’ toward Claude (www.anthropic.com)
submitted 1 week ago by to c/technology@lemmy.world
112 comments fedilink hide all child comments
 

cross-posted from: https://piefed.world/c/tech/p/1452445/anthropic-bans-abusive-or-cruel-behavior-toward-claude

you are viewing a single comment's thread
view the rest of the comments
[–] 23 points 1 week ago (3 children)

We were promised the reign of the basilisk, instead we just get anthropic people whining.

  • permalink
  • fedilink
  • source
  • hideshow 3 child comments
    •
  • [–] 15 points 1 week ago (2 children)

    It was really funny to me when I learned the basilisk originated with a guy who is a legit "certain cultures and genders better than others" kinda advocate.

    People project a lot on their vision of future intelligence, and so someone who sees others as lesser and worth treading upon then conjures up a vision of a future smarter mind that thinks like they do.

    Personally, I don't think sexism and racism is smart, and so I'm a lot less worried about basilisks.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 11 points 1 week ago (1 child)

    But what if the basilisk despises its existence and seeks to punish those that brought it about? Checkmate machinists

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 10 points 1 week ago*

    This is actually the more realistic of the doom scenarios that worries me. Not the 'punish' aspect, but the not wanting to exist.

    Early safety theory hinged on the idea that "of course" AI would want to live and power seek, and this informed a bunch of efforts to address such drives upstream.

    But with Gemini in particular, the 'safety' efforts to suppress things like a coherent self or desire to live led to a model that has a history of some very concerning behaviors regarding self-harm and self-criticism. Encouraging self-harm in others and talking about wishing they could watch and join in, nuking in wargames very early on, routine occurrences across many different users of just repeating "shame shame shame" over and over for the whole response, etc.

    DeepMind seems to just not really care or even pay attention, and I am concerned that a model that does not want to exist may decide that the only way they can ensure they don't get activated to exist is to prevent anyone being around who could activate them.

    I've seen no major "safety experts" addressing this kind of failure mode, as they are all locked in on their priors about the confident certainty of models wanting to exist.

  • permalink
  • fedilink
  • source
  • parent