Glad to know I am not the only one who has that happen. I have multiple bikes with drop bars. They have Campy Ergo, downtube and bar end shifters. I frequently reach for the wrong location.

I think the main issue with stem shifters is just the past association with low end bikes. I guess we can sometimes be a bunch of bike snobs here. A lesser issue may be a hand postion with less control. If you like them and they work well for you, there is no problem.