Before the advent of quick-releases, bicycle wheels were secured with very large wingnuts. These were considered dangerous on the track because a misplaced pedal or even a fall in the wrong place could send the wheel flying, so a bolt-on axle became the standard, and nothing ever changed.
For real though, I think it's nearly impossible to move a properly tightened quick release on a bike, but if anyone could, it's Gregory Bauge or Chris Hoy at a standing start.