Is that a headlight mount?
I think the brake attachment point is commonly used. It looks like it comes awfully close to rubbing the headset. You might be able to gently round the lower corner of the headset cup.
As Andrew Steward said, make sure the recessed nut is set right.
On the front tire, forces would tend to bend the brake forward (and upward). Watch for the shoes rubbing on the tires, but it won't be driven downward and into the tire.
Anyway, I wouldn't worry about it too much if everything is adjusted right.