A Shimano 105 11-speed should (i) have a micro-adjust ability, with which (ii) you can make it so that crossing rubs only on the most extreme cross. My 11-speed Shimano only rubs when I am on the large front ring and largest rear gear, or small front ring and smallest rear gear. You may have to adjust the front derailleur to achieve that.

If you don't know how to do that, and/or are unwilling to learn how to do that (perfectly understandable, though not hard to learn), bring your bike into a good bike shop, where then can make the adjustments, and show you how to trim, for very little money.