I'm always slower in the morning. The ride seems harder, and my heart rate is higher.

Going home is faster, seems easy, and my heart rate is lower.

Clearly something to do with physiology. There are studies which show that this holds true for many people. Possibly our ancestors didn't have to run so fast in the morning while the lions were still asleep.