Too much chain tension is bad. The little play that you describe is actually a good thing.

A too tight chain will destroy your chain/cog/ring/bb/hub bearings.