Knew I had a photo showing it. Not quite as much as yours, but a bit.
My fender is also not centered in this photo, so while I have fiddled with it to get it better at times, I really don't notice the rack.
If you load up that rack, or ride down rocky or potholed roads, I'd worry about that spacer putting a moment on the fastener. Levering the load out like that would stress the bolt more than bolting directly to the fork. Perhaps find a higher grade bolt than you'd usually use to attach the rack to the fork. OTOH, it's not too uncommon to bolt the rack outside the fork, and that usually works out OK.
I'm a bit amused that you're more worried about the rack being off-center, which I'd call cosmetic, than the off-center fender which can start buzzing on the tire.