Bike Tools Etc is a good internet/mail order supplier: Bike Tools Etc. - 1000's of bicycle tools and parts for the home mechanic!

Buy Grade 25 balls in whatever sizes and numbers you want. Grainger, McMasters-Carr and other industrial supply houses also sell suitable bearing balls if you have one locally.