If you have a few pairs, its usually pretty easy to "rotate" them and hang them dry. Also, if they're a little damp, what's the big deal? You'll sweat 'em up in the first 5 miles anyway. Initially it won't be so comfortable, but it won't matter after a while.
Other than that, occasional dryer time...especially with low heat...won't kill them.