I don't grab a wheel unannounced, but I don't get my chamois in a twist is someone grabs mine. Like Mr Pedro, once I notice him, I point out obstacles and if we're going at a good clip after a while I'll poke an elbow out and let him take a pull. Life's too short to let a trivial thing like an unannounced wheel sucker to upset you.