The fact that you could just spin the cranks and "pop" the chain back on would be indicative of a too loose (for my taste) chain. What frame are you riding?