I always take two pair. Try to ring the one pair out the best you can. If you are staying in a hotel. Roll the shorts up (pad out) in a towel to help them dry a bit more.
Assuming it is not raining the next day, damp clothes get hung on panniers till they dry. That right repeat the process with the clothes you are waering.