I recently switched to a new bike with a 50-34 / 12-25 from a 53-39 / 12-25. After a week, I was ready to trash it for the reasons you cite. I liked the flexibility of the 34-25, but found that I was cross-cahining more than I was accustomed to -- I rode the old setup in the 39 most of the time (up to ~21 MPH).

What I have found now is that with the FD adjusted so that I can use my 50 without any FD rub in the 23, I can leave it in the 50 most of the time. It took about 2-3 weeks to really adjust my shifting patterns to account for the different gear combos. Not that I know your style, but I can definitely see that a 12-23 would present problems for me -- I use the 50-21 and 50-23 quite a bit. I avoid the 50-25. On the other end, I do get a little chain rub with the 34-13 combo and rarely use it. I can say that I now really prefer the compact set up. Though I don't have that many climbs about, I really love spinning in 34-23 and, when necessary, 34-25. Now that I have tasted that fruit, I would definitely miss it.