Avoid training wheels if you can. Start with either a strider bike (or take the pedals off).

That being said, I learned with them and haven't suffered any long term negative effects (that I can tell)...