The point brought up regarding headset adjustment is a good one. Either too loose or too tight can be very bad at speed downhill. Another thing to check is setback. I've found that Zero setback posts can cause some squirrelly handling. Moving to a shorter stem and more setback has down wonders for me on a couple of bikes that had previously exhibited iffy handling characteristics.
There are so many variables. It's hard to isolate the cause.