Loose headset or wobbly wheel is usually the culpret. Sometimes it's just the "harmonics" of the bike at high speed (usually a sumptom of lighter frame material). One soluiton is to press your knee against the top tube to dampen the vibrations. Aside from stopping the vibrations it also centers the rider on the bike. Remember to weight the back wheel on the downhill.