I pulled up to an intersection just after an SUV did stopped coming from the street from my right. I stopped fully and put my feet down. I waved him on and he shook his head and waved me on. I hesitated and then took off turning left. The SUV went straight and therefore came up behind me. It passed very, very close and just before he did I turned just my HEAD to look over my left shoulder just in time to see the SUV's giant tow mirror pass over my left shoulder. I swerved right and nearly ran into the curb.
I now insist that if I come to an intersection when a car does too from another direction and I will turn past them or pull into the same direction as them. I will typically refuse to go and wave the car to go first. A few times I've had drivers show frustration as I refused to go and shook my head still waving them on. It was just too close for me and they can clear the intersection a whole lot faster than I can so I let them go first.
Taking the lane has it's merits but you will ALWAYS have motorists pull this crap. Just watch yourself and try to anticipate what they are doing and take the necessary action.