My 2 cents: panniers are great on the bike, but that is not the sort of bag i want to carry around all day.
Also, why are you carrying your suit? Get a chain case and you can probably ride in it. Your bike ride is reqlly short, certainly short enough for "normal" clothing in mild weather.