I used to ride my mountain bike like that. It was a vague experiment, but it actually felt comfortable. Didn't do it on my road because of my lights. But on my fixed, it did feel comfortable. I don't climb like that, but when I'm just riding around. Not to mention it kept my hand really close to the brake I had mounted there.