On one side of the "round part with the hole" there is a little square tab that attaches to the shaft and screw.
That little tab doesn't fit between my drops.




I'm not trying to put them on incorrectly, am I?
That's how I put them on my other bike.