I have an experience that in some first, second and third world countries people aren't really prepared to face that sexual orientation might be different from theirs and that it means nothing. It doesn't mean that they are true homophobes, but you need to invest time in discussions and they might change their opinion afterwards. Clearly most of them would prefer to have a queer nice neighbor than a straight but aggressive idiot. And since you probably don't have time for this sort of discussions with each and every guy who actually doesn't really care, why waste the time and nerves and not just cut it?
Sorry if i'm saying/repeating something obvious.