My doctor wants to discontinue my MS medications

I'm 62 and was diagnoised very late in life, back in 2011, with MS, after a series of falls, and the whole "let's rule this out" routine. I started off on injections, but still had relapses, and was finally put on Gilenya, which I have been on since 2014. At my neuro appointment the other day, my neuro says that he wants to take me off Gilenya, as the risk of infection is now higher than the risk of a relapse. He said that as a matter of course, they tend to stop MS meds at age 55, given that the risks factors sort of swap, with the infection becoming more of a possibility than any MS relapses.

I haven't heard of anyone being taken off MS medication, especially if it's working, and I would love to hear some background from anyone else who has gone through the same thing. I would quit the Gilenya, and then immediately get an infusion of Rituximab. Before all of that, I have to be tested to confirm that I don't have any markers for TB.

Anyone else been taken off their medication when they got older?