Check your headset adjustment. I've had that happen if the headset is binding.
If it's worked it's way to being too tight, or possible dry bearings, it tends to "hold" the steerer into position. The natural tendency of the rake in the fork to straighten out the wheel will no longer work.