Handwash your shorts, then. But if you don't clean them after every ride, you are sitting on a pad filled with bacteria, stale sweat, and ass, all of which can contribute to irritation, saddle sores, and other things that will make you regret your choice not to wash your shorts.