Maybe this is why I am still single. But, If you are on your bike for a few hours a day so what. Your wife should either have her own thing she likes that much, join you, or deal with it. In the long run it makes you who you are, and you would be a different person if you didn't do it.
My Pop ran 2 hours every night after work for almost 20 years. My Mom hated it, but now my Dad it a healthy older fellow who will probably live a lot longer than he would have if he had let her cut into his running time.