Odd that the Swerv shorts fit that way. Their jeans fit me well and I have large quads. I've never really found a short that didn't fit other than print board shorts.
Comfort and fashion are hard to come by with a good price. Like that old hot rod saying, "Fast, cheap or reliable. Pick two."