The shifter must be in the small ring position before attaching the cable. Flip the smaller shift lever several times before attaching the cable with no slack. See parktool.com for shifter installation and adjustment instructions.
Failing that, try flooding the shifter(s) with WD40. This can be done without removing the shifter.