Yeah, I frequently encounter this and think it's a problem too. And I don't know what to do about it. If you don't go, they only get pissed at you. Also, they don't check to see if the other direction is clear. I'm sure bikes wrecks have happened that way. The "courteous" drivers make things more unpredictable and therefore more dangerous.