I have a white bike with red trim, and I wear a blue jersey and a red helmet. I get saluted on the roads al the time.
Anyone ever read the Rivendell catalogue? They insist that no one should have any trouble wearing a long-sleeve seersucker shirt while riding, regardless of the time of year.
A seersucker shirt, these red shorts, maybe some Birkenstocks to go with your pedals. I think it would be a killer look.