Originally Posted by
FBinNY
Patient to doctor while demonstrating, "my shoulder hurts when I lift my arm like this".
Doctor to patient, "well, stop lifting your arm like that".
It' an old joke, but very apt in your situation. Shifting the front under load will cause chain drop. That's because you usually do so when on the inner half of the cassette, and the chain is coming to the chainring at an angle. As soon as the chain disengages from the larger ring, the tension makes it snap inward like a rubber band, and overshooting the smaller ring.
There are fixes as Hillrider noted, and they do help, but the right fix is to not shift under load in the first place. Anticipate your needs and when starting a climb, downshift the front soon in the sequence while your pedal cadence is still high, and the load lower. This also has the advantage of shifting while the chain is feeding straighter, so that "rubber band" snapping is reduced.
I'm wondering if an electronic FD would minimize this result, if not eliminate it. If I understand correctly, an electronic FD doesn't use spring tension to move the chain toward the frame.