My exwifes parents have a place in Door County and we used to like going up there shortly after Labor Day. We didn't bicycle there, but the weather was still nice, it cooled off at night and the crowds were a lot thinner than during the summer. Most of the stores/shops were still open too, and they were glad to see company that wasn't the mob scenes of the summer.