OP didn't say anything about riding fixed, just SS.
But the above answers are still relevant: no, there's no reason that starting back up with a singlespeed is any less sensible than with a geared bike.
And you're right, OP, hybrids are so boring, get with the hep cats.