I find I have this problem only during the winter, from about October onward -- when I stop shaving regularly. Sometimes all that's needed is riding a bit harder ... to work up a bit of a sweat. The perspiration then "glues" the rubber grip band to your legs (are your legs excessively hairy?)

However, this time of year is when I switch to tights, so it becomes a non-issue.