Your experience reminded me of something that happened to my wife and me nearly 30 years ago. We were both working in town and for several months the only riding we were doing was to get to work and get groceries. Well, February came along and we realized that we should start training again if we were going to ride events like the local double century. So, off we went on what was planned to be a 35 mile ride along a local creek. Four miles in, at Road 95, we both were so uncomfortable on the bike that we just turned around and headed home. We still laugh about "Road 95".

Keep at it. Good things will come, usually just after you have nearly given up hope.