That would be the main problem from the wobble...You should have gone with the shorty bars b/c they are designed to be used w/ a road bike and keep your weight over the back tire where it belongs. You are probably very stretched out to reach the bars, which I can't picture as comfortable either after long rides. Also, FWIW, now your bike is most likely not UCI legal anymore