It is probably a consequence of your lack of upper-body and "core" strength. If you want to get better at working out of the saddle a little faster than standard training you should start up a resistance program. Otherwise spend more time out of the saddle and focus on not being sloppy.