It happens to all of us. I was in a race last year that had a killer hill that also had some loose gravel on it. My back wheel slipped and I stepped out of the pedal to keep from falling and ended up walking the bike up to a step so I could clip back in. I'm sure there was a lot of loose sand/gravel on your hill.