I traditionally position mine in the "forward" position. Not up or down, but the the arm extending forward.

I just recently got a set of bar ends that are fairly straight, and I'm trying the mirror inserted into the end of the left bar end itself. This makes it pretty nice -- I can see around by body, no hands or arms are in the way, and I can fully wrap my hand around the end of the grip.