i ride close to 30 miles almost daily (i do have a bus option which i take once a week or so) on a singlespeed with a freewheel....
i don't think it'd be bad once you get used to it!
it would suck to have no other option then the bike, but it will make you tough and certainly is possible!!!