You could move that large rear concave washer from the rear to the front. Then you'd probably have to trim the top end of the fender bracket to get it to fit underneath the headset. It's not ideal, but it might be a solution.

Or just ride with your bag on all the time and you won't notice the angle. Or get help with your OCD.