Yeah, if the distance between the rear cog and BB changes at all, it won't work for fixed.

SS is do-able with a tensioner probably. Still, I'd feel a little uncomfortable.