Stryper brings up a good point; if you only want to swap to SS when you're incredibly tired at the end of the ride... you're still going to be incredibly tired. Spinning is easy anyway.

Also I went from riding 48/16 for a year to 48/17 (both fixed) and barely feel a difference... but some people say even a small change like that is huge, so idk.