I've double checked the frame, and double checked it once more. There isn't any sign of deforming/bending at all. When putting in the rear wheel it falls exactly into centre, so I'm still betting on the RD.
De Vos looks interesting, not sure if I can spare 425 to get 105 installed yet though.