I've always hang dried my biking and other "performance" fabric stuff.. it dries overnight so it's not a big deal. I have one of those pop up hampers that i just hang everything around the edge.

i'd be more worried about the elastic in waistbands and any other place where rubber is involved.. that doesn't react too well to heat.