make sure your headset and wheel bearings aren't loose in any manner.

if they are all good, its a function of the steering geometry and your weight balance on the bike. some tires can aggravate it. changing your handlebar geometry can alleviate it, or riding with your weight in a different place. (maybe more tucked, maybe more upright?)