Being a larger rider, I almost always have to ride off to the side a bit (echelon myself) so if they move suddenly, my momentum doesn't crash me into them.

That said, you need to do some drills involving bumping, over-lapping & touching your front wheel, leaning, etc... to make yourself more comfortable on the bike. Do this, and you'll become more comfortable around others you don't know.