If you want to race, join a local club that caters to young racers. The slow riding won't hurt you but it also doesn't count as training. Provided you have enough time to train properly, a little extra walking or slow riding isn't going to hurt anything.