I let people do it, although I don't do it to other people. Personally, I don't mind so much, but it can get awkward. Think about it, some stranger right behind you...
One day a chick was drafting me on the way to campus. She didn't ask me and we were both late to class but she said "thank you for letting me draft you!" before she took her turn. That was pretty cool.