I can partially sympathize with your husband. Having been temporarily dealt a bad “health” card a few months ago my endurance was cut down to the point that a two mile ride was a challenge. What I missed most was that is was no longer fun, at least not then. FUN being the reason I ride and the exhilaration only another rider will understand. However, my cardiologist (a cyclist himself) kept up the encouragement and the recently repaired ticker (had a blow-out that was patched and good to go) is working just fine. Now at three months post-op the FUN is beginning to return and my health is improving. A double bonus. I guess the point here is that at some point in any endeavor we lose the FUN of it all.... but if you really love it you can sort through all those negative feelings and come through OK. The other side is that you only live once and if riding causes him more grief than pleasure there are plenty of other things you can do as a couple. But keep riding yourself.
Juan