Core exercises will help a lot, also, you are sitting pretty straight up instead of trying to bend your pelvis. This will help you get more comfortable with your arms and help your pedal stroke. I get lazy and start to feel pain, the first thing I notice is that I am bending at the waist and not bending my pelvis.