I do this all the time - it's one of the only things that can get me to push just that little bit harder.
Since I ride a fatbike I don't normally catch them - so far I've managed to pass exactly 2 people, both of whom thought it was hilarious and then passed me and disappeared.
The last "victim" took me 3.5 km to catch & pass.