I had virtually no pain, aches, or swelling and resumed all activities within a few days. That said, I've known guys that had it nowhere near as easy and were out of commission for a couple of weeks with serious pain and aching. FWIW, I would advise taking it easy and gradually increasing activity level evaluating the effects as you go.

Following the doc's advice: I broke my collar bone in a race a couple of months ago. The first doc said stay off the bike for 8-12 weeks. I saw a second doc and he said I should resume riding immediately as much as was reasonably tolerable. The first was a general orthopedic surgeon, the second an orthopedic surgeon that specialized in sports medicine.