If you use a rear brake you'll find that on horizontal dropouts or track ends, moving the rear wheel means the brake pads won't line up with the rim anymore. On race bikes from the 20s and 30s, when flip-flop hubs were standard equipment, the dropouts were angled so that the pads would line up with the rim regardless of hub/wheel position.