I run into this problem on our club rides. On my own I don’t stop for much more than a nature break. The club, great fun folks that love to stop and eat. I just accept that I’m going to hurt on the start after the break. The worst is when the lunch stop comes at the base of a steep long climb…..Oh well, 1st world problems.