Thing is, in any one case we are dealing with a single data point ... and because of that gender-related generalities are irrelevant. In general men tend to be larger than women and have a higher percentage of muscle per unit of body weight ... but when any Individual man is passed (or passes) and Individual woman, it is in no way representative of any general condition.
The OP seems (to me, and this is possibly my misperception) to be more concerned because a woman passed him, instead of a man. I don't see that. I see a rider who was going faster on that day at that time, passed a rider going slower at that time and place. For some reason, the OP seems more upset because it was a woman .... which strikes me as indicative of the slight gender-bias most males in the U.S. have been taught (I am sure in other countries and cultures as well, but I think I understand U.S. people better due to longer exposure.)
Again, this is all just my extrapolation.
That said, in Saudi Arabia women aren't allowed on bikes. Could be a solution involving relocation.