This is something I've noticed not only in cycling, but also with weight training and playing drums. If I take a break, the first time back I'm like Superman on steroids. The second time it all catches up. I've finally learned to take it easy that first session which prevents total collapse during the next one.