Yeah, you spill out (or worse.) but your talk of the contact patch being smaller for a smaller wheel is a gross oversimplification. Again, it has all to do with how you brake and little to do with how much you - as in you, the rider - brake.