As I get older (ahem), notice that I seem to need more time for recovery. I can do up to 2 hour rides almost every day, but once I start on 3+ hour rides, find that I need not just one but often 2 days to feel "fresh" again.
So ... accept that, and just do fewer rides, albeit longer ones, or compensate by doing more, shorter rides?
FWIW, these are fairly solid rides, it's hilly and even mountainous where I am, so I'm usually working, one way or another.
(BTW, this is riding and training for century-type events, though the riding part of it is and remains a pleasure.)