Unfortunately you have the BB in the only position that its definately not going to end up in for your single speed use.
Try it without moving the saddle and see how you feel. Keep in mind you can tension your chain towards both 12 o clock and 6 o clock so try it out both directions.