Yeah, as noted by others, the big thing missing in OPs description is communication. If some silent guy tried to work with me I'd be a tad annoyed, but if the guy talked a bit and made their intentions clear, and also noted how far they wanted to go then it's much better.