We own several horses and have been around them for years. The best I can tell is that horses think that riders are some kind of horse or other animal. Thus the racing mentioned above, but most likely they will spook. When riding by a horse and rider begin speaking in a normal manner, ask the rider if the horse is OK with a bike or simply comment on the weather keep talking the horse will usually settle down. Then ride by.