It's better to take off the pedals and use the bike like a balance bike to develop a sense of balance. Training wheels just teach you to pedal but not to balance. After getting balance, one can then put pedals back on.