Maybe you could hop on another bike and see if you have the same problem. It would be an easy way to determine whether your frame is indeed our of alignment.