REI also has a mini-towel that rolls up to a small case abut the size of a golf ball.

So far I've had good luck with mine, and it dries off quickly if tied to the outside of one's load.