Getting professional advice on treatment is always sound advice. However, while the doc may understand the medical and treatment aspects, he's programed to treat the problem, not necessarily the totality of the patients issues. So the advice tends to be very conservative, staying on the "safe" side, not necessarily focused on a faster return to cycling.

Also, unless he's a sports medicine specialist, or a cyclist himself he may not understand the specific and unique bicycle related considerations, nor the types of changes one may do on the bike that would help.

So the OP is wise to get advice on both sides of the issue and put it together to find his own way through