Chainrings aren't perfectly circular. It's just something you have to deal with. You just need to make sure that the chain doesn't bind at the tight spot or else you'll wear your drivetrain out quicker.