I don't assume, my daughter was a great exemplar for me of what Facebook can be, she was upset that she wasn't "in the loop" when folks were discussing movies to go to or outings, and hadn't seen various photos etc. So signing up gave her a connection to a lot of her friends which enhanced their ability to plan and execute on various group activities. It also opens her up to the 'bad' stuff (stalkers, wall flaming, etc etc). Amongst her friends, who she trusts, it's a net plus to her life.
Similarly people wearing glass around her, whom she trusts, aren't really a threat. So they snap a crazy picture of the pizza cheese that looked like a kitten or a video of an amazing Zelda move, its not a big deal.
My point is that the source of the unease about people filming is a lack of trust in that person and what they are going to do with that data. Amongst friends? Lots of trust. Amongst strangers? Not so much.
So separate the trust issue from the product issue.
Another way to look at this that I just thought about, video camera recorders, aka 'camcorders'. When they came into existence there was a very similar outcry about random people filming random things. But the people who bought them in droves were grandparents so they could take them to their grandchild's house, film their antics and then re-watch them whenever they wanted. They were still creepy if people were randomly filming. So if someone is wearing Glass and it makes you uncomfortable you might ask them to take it off. You're probably not going to ask your in laws who are filming their grandkids, nor are you going to ask the guy who is using it for heads up GPS info while driving a cab, or the store clerk who is doing inventory, or engineer who is sitting in the park reading code. But all of those are solid use cases for it.
I assert that if it fails it won't be because some folks are anxious around others who are wearing Glass.