I have resigned myself to slowing down or stopping if I must to let them pass. I usually say "Nice day for a stroll yeah" or something encouraging. Good karma is always worth the extra effort I figure.