This is nothing to argue about. Some TAs have beveled washers on the base end, some don't. Some fit the hub and frame snugly, some don't. The point is that if you are reporting problems with brake rub after having the wheels out, it is probably because the wheel is not going in the same way it was put in when the brake was centered. Disc brakes are very sensitive.
The "loading" isn't any great force, just pushing down enough that there isn't a question where the axle is centered.
I'm sure some pros have ridden with their brakes rubbing slightly after a sloppy wheel change. It wouldn't slow them down.