Stay on testosterone and take frequent doses of HCG, HMG or FSH, and an AI (Arimidex, Letrozole) and Clomid, and you should regain fertility without having to go off TRT.
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4854084/
"A patient who presents for treatment of male factor infertility, indicated by oligospermia or nonobstructive azoospermia, who either reports a recent history or current use of TRT and/or AAS is a common scenario faced by a male fertility specialist. Several options could be discussed depending on the severity of his hypogonadal symptoms, timing in which he and his partner wish to achieve pregnancy, and assuming there is no clinical evidence of primary hypogonadism.
If the patient and his partner are willing to wait and his hypogonadal symptoms are manageable without TRT or AAS, the patient could simply discontinue the use of TRT or AAS to allow spontaneous recovery. Data from the male contraception literature indicate a reasonable probability of recovery in 67%, 90%, 96%, and 100% of men at 6, 12, 16, and 24 months, respectively, with a median time to recovery of 20 × 106 ml-1 sperm in 3–6 months.13,30,31 Yet, many men will not tolerate discontinuation either due to severe hypogonadal symptoms, uncertainty of recovery, and/or timing issues, and these men may require some form of alternate androgen supplementation. Therefore, one could administer gonadotropin analogs similar to those implemented in patients with HH. Assuming there is no major component of primary hypogonadism, this option is safe, would treat hypogonadal symptoms, and would hasten the time to recovery. It is reasonable to start with hCG 3000 IU subcutaneous injection 3 times weekly for 3 months with additional titration pending interim serum testosterone levels although the optimal hCG dose has not been clearly established. If at 3 months seminal parameters have not improved, one could add FSH. A typical starting dose is rFSH 75 IU subcutaneous injection 3 times weekly.
During gonadotropin therapy, adjunctive treatments with AIs or SERMs are typically implemented. Such an approach has demonstrated excellent results on average within 4–5 months.59 CC 25 mg daily or 50 mg every other day, titrated up to 50 mg daily, may demonstrate improvement in seminal parameters in as little as 3 months for men with HH. CC is cost effective and has been more effective as a combined therapy in this setting, with less extensive data to support it as a monotherapy.80 If the patient exhibits a low T/E ratio, an AI could be prescribed, with anastrozole 1 mg oral twice weekly is a reasonable starting dose that may be titrated up or down according to the response."