If you're able to re-center the rim after removing that spacer, and there are no driveline issues with the current setup, I'd say go with it.