Ahhh yes, the joys of climbing with track bars...
Look at it one way, and the bars will make you a better climber. Just think: no arm leverage to aid your pansy ass up the hill, just you, your lungs, and your grindin' legs. That, and your pedaling becomes smoother uphill, as any side-to-side lurches brought on by uneven pedaling could make you wipe.
Or, they're just a pain for all the reasons listed above. And, because you have to grip the bars that much tighter just to maintain control, your palms and wrists hurt like the dickens at the top.
I spent a summer and a winter grinding a 45x16 up Ravine St. in Cincinnati (not terribly long, but about 12% consistent grade) on both bullhorns and drop bars. Much preferred the 'horns, thankyouverymuch.