Chances are you are not too old. At your age it's really about fitness unless, of course, you have some physical limitations. Didn't sound like it to me. I started riding in my mid-30's...quit for 8 years when I was 50...got back on the bike at 58 and am still riding at age 72. This year I am faster and better than I have been since I got back on the bike. It's about fitness and attitude IMO. Although I have a CX bike and ride the rail/trials, I am 95% a roadie. From what you have said, I'm guessing you will be fine if you have patience with your evolution and just keep at it. Good luck. Enjoy.

BTW...Nomar's girl? As in Mia Hamm?