I'm with Rocket Sauce and miamijim...geometry.

I have bikes that are wonderfully precise, but riding hands-free, not.
The race geometry makes them a little skittish.

Still, some of the funniest wrecks are when some guy rides hands-free and the front wheel does a 170.

I don't ride hands-free, ever. I can barely ride in a straight line as it is.