Also, check your chainline. If it's not straight, even with the proper tension, you can take remove the chain pretty easily.