Handle bars should be straight. I'm sure no folding bike design makes you cycle in circles. If you can't straighten it for some reason, the dealer should sort it out for you.