It might have happened, but people have not called me out on it. I keep far away from swear words while learning a new language.
Something I am struggelig with however, is being seen as less intelligent and less capable because I am speaking with an accent and/or bad grammar. Constantly being seen as less valuable.