I guess you have front opening horizontal dropouts? If you got mudguards on the bike with good sturdy struts,
you can pull the wheel back by squeezing it back closer to the fender.
I dont think I want Chain overtightened..
Thought: no mudguard, have a chainstay bridge ... you could force a wedge in between the tire and the chainstay bridge.
tighten thing up that way, tighten QR lever, pull out wedge..
'banjo bolts' work better with rear opening dropouts .. but they work fine, then.