I do the same thing, wear mesh shorts over spandex. As far as im concerned spandex is better for XC riding than baggies, and i have a pair of Oakley baggies so i know what i'm talkin about. Dont worry about what other people say, if you want to wait shorts over the lycra go for it, no shorts over the lycra great, but really who cares?