It's called "drafting" and you should probably ask first. Especially if you're inches from the person's wheel. If you touch your front wheel to theirs, 90% of the time you;re the one going down, not them, but still, they should know that you;re bac there.

On a related note a lot of us (myself included) could stand to check out what;s going on behind us more often than we do.