"Is it more comfortable to take the stem on the handle bar out so that it sits lower?"
That depends on what gives you the most comfort. For me, lowering the bars is a no-go because it puts too much pressure on my wrists and hands. Lots of riders don't have a problem with that.