I ride a singlespeed downtown and I'm thinking of swapping out the aero brake levers for cross levers, since when I'm in traffic I usually ride with my hands towards the middle of the bars. I'm looking at either the Tektro levers or the more ergonomic-looking ones from Specialized. My question to anyone who rides with this set-up is: Do you ever find it difficult to balance when braking fast, since you're not as well-balanced as you would be with with your hands farther apart (as when using aero levers)? I realize I could just use the cross levers in an auxiliary capacity but I would prefer the profile sans-aeros. Is this a silly concern?