I agree with wolfchild. I'd personally explore "natural" ways to raise my testosterone for a few months, then if that doesn't work, find another doctor and discuss TRT.

A better diet and some strength training can not only boost test, but will improve recovery. And if thats the primary issue, you could also try foam rolling, contrast showers, and eating more. I found that I recovered much quicker when taking a little time to focus on that.