I find I cruise in in the morning, but by morning I mean 10am. There aren't a lot of cyclists at this point and my cruise to work is a nice long down hill (more or less). I love it.
After work is another story. 6:30pm still has a lot of people going home so I'm in amongst the bicycle traffic. It feels very much like a race and catch myself trying to reach pole position of a group.
I've learned to take it easy going home. It's not a race, I don't mind people passing me and will even find myself looking for people to follow behind to force me to pace myself.
No matter what, I still commute faster on the bike than with public transit or car.