Going back to cyclocross bikes, have you ridden the Specialized Tricross yet?
During my search, I rode both the Secteur and the Tricross and favored the latter. While the geometry isn't condusive to super fast like a Roubaix or Tarmac, with a proper fitting, it can be quite the quick bike, with a little more robustness for those trails and cobblestones you sometimes encounter. They also come with more asphalt friendly tires (specialized borough) than other CX bikes that have knobby treads.