For the vast majority of functional interactions between humans, the brain doesn’t bother registering anything about the others person. You can find numerous examples of experiments where someone asks someone else for directions and then experimenters manoeuvre a screen or large object between the two and swap out the asker and replace them with someone else. Nine times out of ten people don’t notice if someone’s age, height, skin colour or sex changes. It doesn’t register. We are all far more self involved than most people think - and we expend far more energy thinking about what other people think of us than we need too.

Short version. You’re probably passing far more than you believe you are because peoples brains are lazy. Unless you provide some contrary evidence that shakes them out of their initial judgment (such as an unexpected super deep voice) then they’ll crack on none the wiser.

Humans are idiots. It’s why I’m a penguin. :o)