Your biggest problem seems to be with your pads. Replacing them first seems like the best starting point. Re shards, I recall from following some other threads that certain rims shed metal bits for the first 100 miles or so. I can't remember what brands but there's been more than one post about bits and pieces in the brake pads of new bikes or wheels.

Have you used the spring adjuster for centering?