I recommend the White Industries Eno Eccentric hub.

A chain tensioner may be a cheap and quick solution on a vertical dropout frame bike but it also looks ugly.

Avoid if you can!