This sounds like what's known as "headset indexing". Some people will tell you it's because you've hit too many bumps, but that's bollocks. As usual, Sheldon Brown explains it. http://www.sheldonbrown.com/headsets...roubleshooting

Scroll down slightly to the section on "indexed steering".