Sure you can crank up the preload on the headset, but that's not good for it... If you don't have play I'd leave it alone.

I don't have trouble riding no hands with properly adjusted (free moving) headsets.