Can you force the chain off at the loosest point (push the chain to the side while turning the cranks, as though you were derailing the chain)? If not, or if it's pretty difficult, then I wouldn't worry too much about it. Also, make sure you don't have any stiff links in your chain. Chances are, the issue is probably not something worth paying attention to.