most people's bodies are woefully asymmetrical. unless it's causing you pain or discomfort, i wouldn't worry about it, they are just shorts. they don't care.