Turns out I had the Litepro chain tensioner handy and gave it a try: It works perfectly to keep the chain tensioned while folding.

And to keep it from falling inwards when unfolding, either use a narrow-wide chainring, or a plain chainring and Birdy's chain protector: