Whenever, I see that the traffic is getting far too hectic and there are no pedestrians on the sidewalk, I always take my liberties.
PS.
As a kid, when I first started to ride in the street, it felt like I was doing something wrong or illegal, because I was no longer riding on the sidewalk!