I had to fiddle with my Ergons and brake levers quite a bit before I found the optimum angles. Here is a picture of what mine finally was set at for me. Having the brake levers and grips at an angle that kept my wrist and arm in a straight line was what worked for me.
Good luck, don't give up.