Yep, a double with an 11-32 is going to have some nasty gaps. You'll probably need to change to a mountain rear derailleur, and the chainline is going to be nasty without a bottom bracket change.

A full double change is best with crankset, BB and both derailleurs (though you can make the triple derailleurs work ok). You'll get the best workable gearing range going for a compact double (50/34) with a 12-27 cassette.