We're about the same age. There is no track around where I live. But we do have plenty of MUP's and I find them fully populated with older guys during the mornings. I would be greatly surprised if you're the only retired guy at the track.
I restore an occasional Craigslist bike. Once I finished a fixie build that the guy that had started... gave up on. It was a hoot to learn to ride fixed.