I used to ride through bad neighborhoods in NYC all the time back in the late 80s, well before the yuppies started taking over and rarely had any problems. There were a few times people would shout something but nothing major, I was usually rolling pretty fast anyway so no problems. If you feel there's a serious threat to your safety then just find an alternate route.
__________________
I like pie