If you are talking about either SS or FG, lots of people do this. The only issue is ensuring a reasonably straight chain line. You can achieve that with spacers, either on the chain ring or the sprocket. If you are keeping a rear derailleur, you'll have to finagle the chain ring so the chain is reasonably lined up with the middle sprocket on your FW or cassette.