Don't get training wheels - see threads on teaching your kid to ride.

Buy bike, take off pedals and get him to scoot around/roll down gentle slopes until he gets used to balancing/steering and can keep his feet of the ground for some time.

Put pedals back on and watch him ride.

Then your troubles will begin.