It sounds like you've had a lot more to get over than just a fractured clavicle - don't be too hard on yourself so soon. Surgery takes some getting over - it's like an extra level of muscle/soft tissue and maybe nerve injury to recover from; I'm guessing your body's got quite a bit of healing to do as it is. Everyone's experiences are different so just work to your own timetable.
Good luck and heal fast.