Damn that's crazy. My commute is 31 miles round trip, mix of arterial, neighborhood and rural roads, and I've NEVER had such things happen to me. Even people yelling or otherwise saying anything is extremely rare. Number of close passes per year can be counted on one hand.
But I also have to wonder where the OP is.