I've ridden through a lot of bad neighborhoods. Seems like afternoon is the worst time. I haven't had problems in the morning or at night. But all the trouble I've had was in the afternoon. My theory is that in the morning, bad boys are asleep, and at night, they are busy partying or just that the bike is less noticeable.
Just my experience.