It's slightly less work to simply lower if by swapping spacers bottom to top, but that offers you limited adjustment. Depending on the angle, flipping it makes a far larger difference, and then you'd fine tune from there.

Neither makes any difference in handling other than the effect of the lower final height, which usually increases front end weight slightly. That shouldn't bother you. Do what's necessary to fit the bike to your needs and comfort. Everything else is secondary.