If its just your daily ride, the warm up miles is the culprit. Try re-setting your bike computer after reaching a certain distance. For instance, 3 miles out. As long as you know its 3 miles out, you can add those miles to your daily miles but still subtract that average speed to figure out what your average is after a nice warm up.