I have had this happen before and my favorite thing to do is drop em. I will alter my route if necessary to find a gradual or even steep hill to loose them on. If they can stay on my wheel I will then pull off and tell them it is their turn (potential training partner). If I drop em I just keep on trucking........
Most folks I meet drop off once the pace starts to better 24-26 MPH.