I have a pair of shorts that tend to do that too. I've learned to be Very Careful when dismounting when I'm wearing 'em.

They have a drawstring that I'm careful about tensioning, yet it still happens. Hence the caution.

I don't bother with shorts when I'm on my trainer though so it'll be a few more weeks before I have to remind myself about this issue....