Votes don’t do anything on the fediverse so don’t be afraid to speak your mind. If you get downvoted, nobody really cares. I’d rather be downvoted than have my post sit at 1 score with no replies. At least then I know people bothered to read it.