It difficult to tell what the source of your problem is. However, if your feet touch the ground when you are seated on the bike, I would guess that your saddle is too low -- assuming you have a road bike. However, since you appear to be a beginner, I suggest you find a bike shop that does fittings. It takes 2 or three hours and can cost $150. or more. However, it's normally a one-time expense and can make the difference between a properly setup bike, that you may still have to get used to, and getting discouraged and not riding anymore. In a fitting they will adjust the saddle height and fore-aft position, adjust your overall reach, which may require replacing the handlebar stem, and ensure you are using the correct saddle.