Be sure to check your lateral spacing to ensure there is adequate preload since you have played around with your spacing due to binding. If the wave washer isn't adequately compressed, the inner race isn't preloaded and the bearings can click/rattle.