I have Brompton, with no rack and just use the T-Bag on the front. I had seriously considered a rack but as I talked it through with the dealer - how I planned to use the bike - he suggested that I not get a rack and just use the front luggage carrier. Having said that, for other Brompton owners and other owners of folding bikes, a rack can make good sense.
I were the OP, since he doesn't use the rack I would remove it but hang on to it in case I found that removing it didn't provide the advantages I imagined.