Do your tires have knobby tread on them? If so, you may be able to get less rolling resistance and a faster 'feel' on pavement by simply switching to slick tires with no tread. And you could almost certainly run them in a narrower size like 28, even if you don't/can't go all the way down to 23 or 25.