If you have to raise the seat one in ten rides, you made the right call. You're probably using street shoes for short rides, so a short seat won't be much a of a deal.

I honestly think it would be easier to buy another bike than switching pedals all the time.