Life is short, so live it in a way with the fewest regrets.
While we all love riding our bikes and racing them, family is much more important. The love of a father to his wife and children is beyond measure.
At the same time remember that your family loves you and they want you to enjoy your life. They should also be willing to make some sacrifices on your behalf because they love you and want you to be happy.
Somewhere in all of this is the perfect balance. I hope you find it.