I'm not certain how old you are. But at my age 66yo and being retired for quite a few years. I find that I don't have enough overall activity to keep all my muscles toned up and probably am losing muscle mass where I shouldn't.

Cycling only helps leg muscles and the heart muscle. It doesn't do anything for the others. So possibly just working out in a gym to keep all the rest of your body in good shape will help. In the last five years, I've gone through a lot of minor gripes of various this and that. And working out to tone up those muscle groups involved really helped a lot.

Try some exercises to strengthen you abs and your arms and shoulders. Poor posture in your shoulders can affect how your hand hold the bars. Also get one of those grip things to squeeze while you are sitting around.