When the chain is under heavy tension, such as climbing, the front derailleur has a tough time moving it, in either direction.
Most FDs use the spring to shift from large ring to small, so you are at the mercy of spring strength. Shifting up, is based on your force on the shifter, and flex in the derailleur. Either way, ease up on the pedals while shifting the front.