I wonder if the reaction is because Japan is one of the countries that drives on the left side of the road? They either went left or spread out left and right.

I would guess that would affect how you react; you've spent your lifetime being trained in how to respond. It's like the "slower traffic keep right" signs in the US. I wonder if that were repeated in the US if people would move to the right?