You should tighten your cleats down. Float has nothing to do with the mounting bolts on your cleats. Secure the cleats to the shoes. What pedal system did you go with?