32mm is not the issue, nor is the rim width. You are easily in the range where low pressures should work fine short of pinch flats. But as far as a smooth ride goes, Gatorskins are the absolute worst you can get in an air filled tire.
There is a point where a tire can roll on the rim at low pressures, but even for me, at 240 pounds, that is in the 25psi range with 42mm tires on 23mm (outside) rims. This is a sudden and frightening transition, not an issue with general handling precision.
I hated the Gatorskins so much, I removed them after only a week. I would rather use a latex sealant than use stiff puncture resistant tires, and it works better too.