I don't think you can fix both problems with one bike - a bike with wider tires or suspension will help with the rough roads; a lighter bike with thinner tires will help you go faster.
I had an Escape 2 for a while; nice compromise between speed and handling rough roads. I switched to a Marin Fairfax with 32mm tires - I'm faster but feel the rough road more.