There's one portion on my commute, similar situation, but the "detour" onto the sidewalk is maybe one city block, if at all. Generally it's' WAY too early for pedestrian traffic and there's just very little foot traffic on those sidewalks even during "normal" hours, so I don't really run into "traffic."

However, I'd err on the side of caution and slow down, yielding to pedestrians on foot and those not moving as fast as I am.

Bide your time, be courteous, and then when you're past it, resume your normal riding speed