Years ago my GF of 2 weeks expressed her fear about me cycle-commuting because of the danger factor. My reply was that I'd been doing it at least 20 years on and off and I was comfortable in traffic. Her reply was that she wasn't comfortable w/me in traffic. So, I thought it over and said that as we weren't too deep into the relationship maybe she needed to look elsewhere because I wasn't going to stop to appease her fear. That was in 2004. We married in 2007 and had never had another conversation about the subject.

Obviously, the OP's situation is different, but I believe the answer is the same. Do what you want and the people around you will adjust. Or not. Either way do what you want.