50/36 with 12/23 makes a lot of sense based on what appears to be your preferred gear combos. For most riding, I don't thing you'll find that big a difference. Of course when you have steep hills all day, it might be worth throwing on your 12/25 and you'll be able to spin up some climbs you'd normally have to stand on.

Having said all that, if you only want to deal with one cassette, I don't think the compact would be worth the money even if it would be a slight improvement. 53/39 with 12/25 is really versatile when you get right down to it.