An "indexed" steering race can cause this symptom.

Bikes *never* travel in a perfectly straight line; they oscillate right and left in (depending on how good the rider is) long or very long S-curves.
With an indexed headset, the oscillation pauses at the index point before continuing on the other half-curve.
The sensation is that the bike is suddenly preferring the other side.