I second, third and fourth the "Listen to your body" and "Ride for fun" -

You are being very conservative, which is most circumspect. But, don't be afraid to push a bit more. It will not kill you (please don't have your wife respond and tell us it did!)

Mostly, smile!!