dremel the axle, not the dropouts.

spacers do come that thin.

cram a rag between the seattube and the tire to get the chan tight, then tighten one side so that the wheel is sligtly diagonal to the frame. pull the wheel straight, then tighten the other side.

remove the rag and ride.