Just use a threaded type stem. Loosen the nut to realign the handlebars. If that's not quick enough then add a quick release to the top.
This is how one of my folding bikes does it. Nothing fancy; just a normal threaded stem with a quick release bolt.