You can usually file people into two crowds when pointing out to them that they're not behaving very nicely.
You've got your A crowd, where they go "Ah shit, you're right, mb. Just having a little banter, I'm sorry."
Then you've got your B crowd which consists of people who when confronted in a calm and nice manner will just double down on being an asshole. I guess because of weak and fragile ego?
It's never too late to disassociate yourself from the wrong crowd, buddy.