I used to have the same difficulty before I lowered the bars by reversing the stem on my Roubaix. Now I can ride for miles without using my hands. The change gave the bike some degree of positive stability as opposed to neutral or negative.