I was looking at the phrase "most" male riders. There are so many possible scenarios covered by that part of your post that it's unfair to generalize. Psimet's point about "me time" is a good one, but I'm wondering if that's possibly more about family vs non-family time rather than male vs female riders per se (?) Either way, I enjoy rides where we have some male/female balance.
[PS - my thread trainwreck alert has just kicked in]