I think I'm more OK with running things close to the clearance limit than perhaps most people, and that's about as tight as I'd go. You could take some measurements and see how much clearance a 650b conversion would get you, but that'd involve new wheels/tires/brakes. Or use this as an excuse to get another bike that can run fatter tires for gravel rides!