I've done it. If you can breath and ride the bike without discomfort, it's not that bad. I was unable to ride out of the saddle w/out significant pain so that was the biggest issue for me.
You're the only one who can really answer your question, so give it a few days, keep riding and then decide.