I honestly think a few pounds of gear more or less makes way less difference than wind strength or direction: a factor that can rarely be planned for if the goal is a certain distance in a day.
Some days you fly, some days you slog.
For me the biggest factor is getting up and away early in the morning, and getting lots of miles in before lunch break - especially if riding in hot weather. I typically wake up at 6 a.m and am on the road an hour later. I love the early morning hours

Probably true, but it does sound like OP has some quite old and heavy gear. One doesn't need to go extra light, but if you're getting new gear anyways I suppose you may as well cut the weight down (this often, but not always, means quality gear as well).
It helps if you are also into backpacking, but I know many may not do both.