You could probably get away with just having the front brake. Just don't line up near any officials
Seriously though all you need is a front brake to stop the rear does like 5% stopping so it's almost worthless. I do however use the rear wheel to skid around tight corners sometimes but rarely.
I've done sanctioned TT's on a fixed gear bike with a front brake only and no one ever said anything.