It could also be the headset not being faced correctly; frame out of line; weight distribution of rider; head angle/fork rake; unbalanced or out of true wheels or any of the above already posted! There may not even be one correct answer.

I hope you isolate the problem. Good luck!