if you're uncomfortable sitting in the peloton for a few minutes then you should wait for all of them to pass and then go on your way. it may not be fair, but the group has right of way due to their numbers, velocity, and 'take the road' mentality.. like someone said above, the group-think.

but since you find yourself in the middle of the B group and want out, sit up, put your left hand up in the air, and look back to signal that you're not part of the group and they should give you wide berth.