If your shifters are friction maybe you need to add friction at the shifter. If you don't have enough friction the front derailleur spring will pull the derailleur toward the frame.