I rarely ever see other bike commuters in my city and my route doesn't have any bike paths or lanes that I can follow. However, I seldom get honked or yelled at. Maybe once every 6 months or so. Perhaps you are doing things that surprise drivers -- like not being visible enough. I am convinced that one reason why drivers are generally polite to me is that I am extremely visible. I always wear bright jerseys or jackets (usually neon green) and have 3 taillights and 1-2 headlights on my bike. I keep a consistent line about 3' from the curb, enough in the lane where drivers see me but not so far right that they try to squeeze by. Another factor is my route. I try to stay off the busy roads as much as possible. My route is 2-3 miles longer than the shortest route to work because I take neighborhood streets and less traveled roads wherever possible. I only ride on the busy 4-lane roads when there are no other options.