Before you do anything, check your saddle position to be sure the nose isn't pointed down. The saddle should be level (or close to it). The most common reason new riders feel soreness in arms, hands and wrists is too much weight is held with your arms. The saddle should keep you balanced on the bike so you aren't using your arms to hold your body from going forward.