I don't see any mention in your post about the distance and intensity of your rides. After 30+ years off the bike, you need to work back into it gradually, to give the muscles and especially the joints time to get used to it. Don't go too hard or too far at first. Slowly increase the distance or time of your rides, and intensity of the effort. Give your body time to adapt and adjust to the demands of cycling. Good luck.
I think that was my main mistake when I started, too much too fast and not doing right what I did do.
I am looking into the "toe out" possibility. It looks like my feet are pointed out too far. So I am going to really check into this because it could help me just in cycling but in walking to. I use a inversion table for my back and neck and that helps a lot because my posture isn't the greatest but I hadn't considered my feet. I can see how pedal extensions help keep your feet in line.
Man, riding a bike wasn't this complicated when I was young bugger (of course riding that 10 speed rode bike without proper set-up then probably didn't help) .