when I notice someone is right behind me I will start signaling potholes and things blocking the way and enjoy the reduced drag it gives me.
If you really don't want someone behind you, you can always warn them that you suffer from a runny nose and they might have to duck for a snot rocket every now and then...