Probably not.

Single speed bikes are picky about chainline so you'd have to check that out.

If you have vertical dropouts, you have to have a way to adjust your chain tension. The simplest way would be to keep your rear derailleur but, if you do that, what's the point?