I make note of both my riding time and average, and (to an extent) my overall time. For my overall time I dont usually include the time for a coffee stop but do include all other time (traffic lights, flat tires, regroups). I dont know that either method is gospel for the effort for a ride.