As others have said, first priority is to maintain control of your bike. I always signal with my left hand/arm, and keep my right hand on the brake lever when turning. My brakes are set up such that the right lever controls the front brake, which is my primary brake. To be honest, I don't understand why bikes are set up the other way around with the left lever controlling the front brake.