move the cross levers farther apart
yours are currently clamping onto the tapered section of bar, which is bad anyway. have to clamp to a cylindrical, not conical area; less the clamps have a tendency to squeeze themselves out of position
get levers with smaller diameter clamps and mount them on the 24.0 section of bar father out.