On my FX 7.4 I went from 32mm Bontrager AW1 which is a fairly smooth road tire to 27mm Vittoria Open Pave which is lighter, thinner tire that takes higher pressure. Big difference in the way the bike feels and steers, more responsive and seems faster. Thats great on the road or trail but around town with bumps, sand and gravel it's a much harsher and less steady ride. I'm more reluctant to go on limestone trails but do even though they just aren't suited for it.
Next time I'll go wider as much as 32mm but in a lighter tire than the originals, a sure feel around town is more important as I age than the illusion of the little bit of speed gained on the road.
I'd think going from 35mm to 32mm would make a big difference in feel depending on the weight of the tire and tread. I've got Schwalbe flat resistant tires on another bike, not sure of the model that are great tires but kinda heavy.