There's also some good riding heading northeast from Bridgeport. My favorite ride is all along the CT shore to Narragansett Rhode Island. Let me know if you're at al interested in that route.
Heading toward Westport from the Bridgeport Ferry is a little seedy for a short while. Heading in the other direction is a little seedy for a little longer. In the direction you will be heading, it gets much better once you've left the general area of the ferry terminal.