Me too, go ahead - it doesn’t matter.
What matters is when people scan your post history and check why you were downvoted, given the context of the comment. The community here is smaller, so if you post consistently, you can actually build a meaningful organic reputation (that is: other user’s opinions of you). Karma doesn’t matter. What you post, and how you engage with other users does.