Yes. When you're on a fix and your pedal does more than scrape the ground you can get into some big trouble. The momemtum of the cranks will push your back wheel off the ground. I imagine if you're going fast enough you could get launched right over your handlebars.
The dude I was following fishtailed a couple of times before narrowly dodging a head on collision with an SUV. Lucky.