I ride slower heading towards work and faster heading away from it. The time of day does not make a difference just the destination.
However, in the morning I have a heck of a time raising my heart rate and the opposite occurs after work. I think I may need to shift my calories around.