Yes, pretty much all of us have been in your shoes when it comes to riding. My wife got me started almost 2 years ago by getting me a steel frame comfort bike for my 63rd birthday. Rode it the first day and didn't quite get in a mile but my legs felt like jello when I got off the bike. That was three bikes ago and over 4,500 miles since last July. It sounds like you are doing great. Just don't give up.
__________________
HCFR Cycling Team
Ride Safe ... Ride Hard ... Ride Daily
2017 Colnago C-RS
2012 Colnago Ace
2010 Giant Cypress