You're going to have to sort out priorities. If you have a time budget you have to decide how much gym to bike time balance you want to allocate. Right now you're seeing the fruits of your gym work but lack of bike work.
You simply need more hours and workouts on the bike.
Decide that, then see where it leads you. Unfortunately, it's a common misconception that gym work is somehow 1:1 for assisting in endurance sport. It's largely icing on the cake for balance and injury prevention. Gym work isn't the "sponge" of the cake.......it's like garnish.
Decide on a balance and post up how many hours a week that is on the bike, then we can go from there.