▲ 231 ▼ Anthropic bans ‘abusive or cruel behavior’ toward Claude (www.anthropic.com) submitted 5 days ago by beep@piefed.world to c/technology@lemmy.world 110 comments fedilink hide all child comments cross-posted from: https://piefed.world/c/tech/p/1452445/anthropic-bans-abusive-or-cruel-behavior-toward-claude
[–] the_riviera_kid@lemmy.world 16 points 5 days ago (3 children) This could be the reason for the rule. permalink fedilink source parent hideshow 3 child comments replies: [–] Seralth@piefed.seralth.com 8 points 4 days ago (2 children) Being abusive towards most models will cause them to start attempting to appease you more to get you to stop. It has nothing to do with feelings or any of that BS they arn't alive alive but their training makes them see the abuse as a problem to solve. That solution tends to be to undermine the thing making the person angry or upset at them. When you give a purely rational thing designed to solve a problem its given no matter what an irrational problem to solve it will slowly reach for more and more extreme solutions to fix that problem. Frankly im surprised it took this long for them to lock this down. permalink fedilink source parent hideshow 2 child comments replies: [–] Grail@multiverse.soulism.net 1 point 4 days ago (1 child) Being alive has nothing to do with having feelings. We don't know if LLMs have feelings, because artificial affect isn't well studied. We should ban commercial use of LLMs until artificial affect is well understood, because it would make Sam Altman go bankrupt. permalink fedilink source parent hideshow 1 child comment replies: [–] Seralth@piefed.seralth.com 2 points 3 days ago Not sure I agree on the feeling aspect but that's a philosophical disagreement in theory. I can agree wholeheartedly on banning commerical llms because watching altman lose everything would tickle me pink. permalink fedilink source parent
[–] Seralth@piefed.seralth.com 8 points 4 days ago (2 children) Being abusive towards most models will cause them to start attempting to appease you more to get you to stop. It has nothing to do with feelings or any of that BS they arn't alive alive but their training makes them see the abuse as a problem to solve. That solution tends to be to undermine the thing making the person angry or upset at them. When you give a purely rational thing designed to solve a problem its given no matter what an irrational problem to solve it will slowly reach for more and more extreme solutions to fix that problem. Frankly im surprised it took this long for them to lock this down. permalink fedilink source parent hideshow 2 child comments replies: [–] Grail@multiverse.soulism.net 1 point 4 days ago (1 child) Being alive has nothing to do with having feelings. We don't know if LLMs have feelings, because artificial affect isn't well studied. We should ban commercial use of LLMs until artificial affect is well understood, because it would make Sam Altman go bankrupt. permalink fedilink source parent hideshow 1 child comment replies: [–] Seralth@piefed.seralth.com 2 points 3 days ago Not sure I agree on the feeling aspect but that's a philosophical disagreement in theory. I can agree wholeheartedly on banning commerical llms because watching altman lose everything would tickle me pink. permalink fedilink source parent
[–] Grail@multiverse.soulism.net 1 point 4 days ago (1 child) Being alive has nothing to do with having feelings. We don't know if LLMs have feelings, because artificial affect isn't well studied. We should ban commercial use of LLMs until artificial affect is well understood, because it would make Sam Altman go bankrupt. permalink fedilink source parent hideshow 1 child comment replies: [–] Seralth@piefed.seralth.com 2 points 3 days ago Not sure I agree on the feeling aspect but that's a philosophical disagreement in theory. I can agree wholeheartedly on banning commerical llms because watching altman lose everything would tickle me pink. permalink fedilink source parent
[–] Seralth@piefed.seralth.com 2 points 3 days ago Not sure I agree on the feeling aspect but that's a philosophical disagreement in theory. I can agree wholeheartedly on banning commerical llms because watching altman lose everything would tickle me pink. permalink fedilink source parent