Got about 1.5 mm clearance on either side at best and thinking I may need to size down to 25c

With wheels tightened down sufficiently, should I expect any rubbing with the 28c tires?