I think it's more complicated than that - and I think economic and social class have a part to play in that complexity. You could argue (and I would) that the further up the class system in a stable functioning society you go, the more insulated you are from the danger of men.

Women in the nobility were significantly well insulated from rogue men of lower classes. In our own society the Queen is only really likely to be assaulted/sexually assaulted by someone within the monarchy. She is still a woman, but no man would dare touch her. This falls down when a society breaks apart, in war (as in Afghanistan) the rules which govern the conduct between classes break down and rape is used as a weapon.

So yes, I agree, but with a few caveats. Women further up the economic and class food chain are able to mitigate some of the risk of sharing the planet with men in normal circumstances. Perhaps this is why 'marrying up' was such an important thing to do. The worst position to be in was a woman in the company of a gentleman of higher a higher class or economic status.... or worse, being the lowest class, single and needing to provide for children. I think that's still the case and that's why we have Epstein, Maxwell, Prince Andrew and R-Kelly to contend with :o/