Anyone that gets upset by this needs to STUF and HTFU. Obviously you would be more of a nuisance to remain in the middle of the pack if you are unable to keep pace, and those that are behind you will need to eventually close the gap that you leave as you get slower. Just make your intentions known and gracefully exit to the back of the pack.