On a multi-day tour it is definitely a good idea to have two pairs of shorts/bibs. However, if you wash the set you have been wearing and roll them out in a towel they will dry overnight.

As for hygiene during the day, if you wouldn't carry wipes etc while wearing underwear, why would you when wearing chamois-lined shorts? It's not a problem.