When a person says "No" but it's interpreted as "Maybe, if you press the issue. I'm just being coy." and further advances continue, it's sexual harassment.

The other situation is where saying "No" to sexual advances carries implied or stated negative ramifications in other areas, i.e. I didn't sleep w/ the Director so I didn't get the lead role, I turned down the boss for a date and got a terrible job performance review the next week. That's the other pattern that companies try to avoid by banning boss-subordinate relationships, etc.

How any of that is unfair to men is beyond me. Unless it's a man who thinks it's his right to exploit women or ignore them when they say no.