Most people seem pretty cool with strangers latching onto their wheel if asked, but I can't blame anyone who isn't. If they don't trust their own group experience, or yours, or if they just want to be alone, are all reasonable objections.