You asked about 20 years ago. I was still riding regularly back then, and I'm about as fit now as I was then.
But if you had asked about 15 years ago or 10 years ago or 5 years ago the answer would be I'm way more fit than then, because that's the time period during which I stopped riding almost completely.