I've never had any problems with chafing. That said, I've never even ridden ten miles in one go, but I can ride it in my jeans with no problem.

Anyone who does have problems riding with street clothes, and I can imagine some kinds of problems would be more common for guys than girls, should be able to use whatever specialty clothes they want if it improves their comfort.