I'd concure with Patch. Use manual focus and pre-focus on a patch of ground. Follow the riders and take the shot as they come into your pre-focussed zone. Calibrate the shutter lag so you know how to take the picture before they reach the focus zone. Pan the shot. You can use background blur creatively to give a sense of speed, but master sharp photos first.
Try using a tripod or support.