I'm using a 140 mm adjustable stem on my Swift to make up for the too-small frame size. This helps but makes the steering a bit unstable. I was what your 180 mm would do to the handling.

The problem of fitting folders to larger riders isn't discussed much here unfortunately.