Looks like you're stuck with 23s; adding even more dish is a bad idea. If you had to go the other way, removing a mm or so wouldn't be the end of the world, albeit a bit nasty in principle.
But first, maybe make sure your wheel has enough dish in the first place - is it the same if you flip your wheel?
Or perhaps you could consider having a slight dimple put in the stay...