I'd bet that many of the drivers we encounter would use that exact same argument to force us off the road. It's wrong for them also, because it's none of their business and this "costs me money" argument dissipates into wisps whenever you examine it closely.