That should not happen, and as others have noted, is unlikely to be a headset-adjustment issue. My first thought is "is the fork backwards?" Other possibilities include fork and/or frame bent out of alignment. What kind of bike is this, and in what condition? Has it been seriously neglected? In an accident that may have bent the frame or fork? Can you post some pictures?