When you get back on the bike depends more on your risk tolerance than anything else, IMO. And pain tolerance. It was 3-5 days for me, for a broken collarbone.
You're not necessarily going to know when or if the bone is knitting by feel. The first stages build some connective tissue, sort of a precursor to the bone knitting, and that can feel relatively normal and pain-free but it's not knitting and it isn't guaranteed to mend either. So I caution strongly against thinking you'll probably know and basing your decisions on that.