Tighten the brake calipers mounting nut until the caliper will maintain it position. Use of that "centering bolt should not be needed and it won't keep the caliper from pivoting off center if the recessed mounting nut is too loose.