I should add that my biking is at 17 MPH average for at last 3 hours/day.
Eventually you will be happy with your performance and muscle mass if you keep it up.
Chinarider is right that upper body muscles need Gym training or equivalents.
Many of us bikers do not want to drag that upper body weight up some hill.
That is a personal preference.