Many people here hate wheel suckers due to safety reasons. The risk of a stranger riding your wheel and you have no idea of their abilities can be alarming to some. It doesn't bother me at all, most people that get on my wheel do it because I'm a bigger guy and they feel they will get a better draft.

You did the right thing to wave him off and move on. If it bothers you to have a wheel sucker just keep doing what you did, or slow down so they will pass you. There are worse things out there than wheel suckers, but make the best judgement for you.