But since the caliper is attached so close to the hub, it is unlikely change much compared to the rotor when the blade above it flexes.

In contrast, rim brakes are located as far as possible from the hub, so all the frame or fork flex happens between them. Which is why some rim brakes rub a little when you are sprinting.