One of the issues is that there are legitimate uses for the tech. Like there was a post recently of a girl with hearing disabilities, ecstatic that she'd gotten glasses that provide real-time subtitles to people she talks to. A business / space with a "No Smart Glasses" policy, could essentially be denying people with disabilities access, which could land them in hot water just the same as allowing unfettered smart glass recordings.

Having them become more ubiquitous will also likely have severe impact on regular day to day interactions, even outside of the pervo-sphere. Talking with friends, or even interactions with other parties, can become a lot more complicated when people can record every word, can take those exchanges out of context, and use them against you in things like court proceedings. Eg. friends will often embellish comments/positions a bit for dramatic effect / story-telling purposes, with an understanding that it's not got to be perfectly accurate / you're going to be held accountable for every phrase. So you're right, that the more 'obvious' recording setup of phones limits this risk a bit... but not for long.