"Is it just so you have some way to adjust chain tension"

yes.

just for clarification, most of the bikes here have track ends (open backwards). horizontal dropouts are the older style that open forward but are longer.
http://www.sheldonbrown.com/singlespeed.html