+1 on more shorts.

however, if you handwash the chamois you can dry them fast with the aid of a hand towel. wrap the shorts in the towel, inside out of course so you get the chamois properly, then roll up the towel. kneed and twist the towel.

viola! shorts are 90%+ dry in 30 seconds.