Not owning a car in a suburb of Bumfuckville, USA is a much bigger disadvantage than not owning a car in NYC, Tokyo, or Hanoi.

Yes, it is a privilege. I grew up in a rural area (about 60 miles away from the nearest city) with no access to public transportation or services. It would take FOUR HOURS to walk to my nearest friend's house. I also grew up dirt poor and couldn't afford driving school. So, I had to convince friends to show me how to drive, or get friends' parent to show me, and eventually during my senior year, I convinced one of my teachers to let me take the behind the wheel test in his car. All of this because without a license where I grew up, you're never going ANYWHERE. No job, no friends, no mobility to get out of a shitty rural town. So yes, to not have had to do all of that, that is indeed privilege