Most likely, you have insufficient core strength. Stringbreaker is right that bike adjustment can also cause it, but if you focus on the core, you will be much stronger on the bike.