OP, you're overthinking it. The kind of change you're talking about is nominal and probably won't yield any improvements, in fact, it sounds like what it is - a compromise. If you want to ride more and faster, then ride more and faster. It's as simple as that.

Of course you can be a better cyclist than most bodybuilders, and can have a more developed physique than most cyclists - you should be happy with that! But face it - there's a reason guys who look like Froome win the TdF and guys who look like Schwartzenegger can't get through a single stage, and this tendency holds true down to the local club and Strava level. Surely a guy who needs time for video games is NOT going to be the exception.