use an old tube wrapped around the seat post as a handle to help their balance on the bike.

it beats bending over trying to hold the seat on the smaller 12" wheeled bikes.

this method worked quickly with our 4 year old. he was scared of losing the training wheels, but we made him lose them on his birthday.