Are you saying that the handlebar moves will move so that it is not square to the front wheel? Since this is a new bike I would take it back to the shop. Get them to adjust it. It is not that hard to do, and I had actually written instructions. Then I realized that if you have a threadless headset it may need adjusting, and, no offense, you probably shouldn't do it yourself. Don't ride it this way since it could mess something up.
__________________
If it ain't broke, mess with it anyway!