Don't lean on the bars, support your body weight with your core muscles. Make sure your fit is good so you are balanced on your saddle. With practice you will make quick shifts so your hand is only off the bars very briefly.