Please get properly fitted for your bike. Betting that the seat isn't high enough and you are stomping on the pedals (no clipless) and the stem is too short causing you to not be fully extended. The pressure on your arms indicates that your center of gravity isn't correct and too far out from where is should be.

New riders often ride without being properly fit.
Cycling should never hurt like that.