If the bearings are new and you feel better doing that go ahead - just be advised that it will have no significant effect on your speed or ease of riding. If the bearings are used then the problem that caused the roughness will not go away from polishing.