It's so not worth getting your blood up about it. I ride in the loop and have to deal with it too. If you want, get a bell, whistle, horn, etc. and try to clear the path, but I wouldn't count on it. Look at pedestrians like cows. Slow, dull-witted, they ain't gonna jump out of your way, and you don't want to crash into one. Give them a wide berth and just accept it as part of city traffic.
Bear in mind that drivers often have an irrational hatred of cyclists because of almost the same reasons that you get agitated at pedestrians. Nobody likes being slowed down, but don't get a sense of entitlement about it.