Fuji Sportif
I am 58 and I just purchased a Sportif 1.5 54 frame and I love it. Actually it was this site where I read that the endurance style frame is good for comfort.
I think from your pictures you are very close to the right fit. 35 miles is way too many miles. My first ride a year and a half ago I did ten miles and everything was sore.
I am 5 11, and I do not know my inseam. I measured my Fuji and from the top of the seat to the middle of the crank is 29 inches. At the front of the seat to the middle of the handlebar is 19.75 inches. We are close in height so these measurements should be close for you.
Basically I think you are doing too much to fast. The Fuji sportif frame is very forgiving. I have a Specialized allez which I love but it is harsher.