I’d be inclined to get a dowel to match the radius of the spindle. I’m not sure you can pinpoint the exact location where the balls will be running on the cone surface. You’ll also want to apply even pressure.
I’m not sure if wet-n-dry or crocus cloth is better. Wrapping the dowel with whatever you use might give a more even result.
John