Depends on you. Can you feel the bumps of the patches when you ride on a smooth surface? Does it throw your wheel out of balance at high speeds?
I don't use a patched tube for anything but to get me home. But that hasn't been for ages. Usually I'm close enough to call my wife to bring the truck.
Not that I don't trust them. Just a quirk and preference of mine. I keep going back and forth whether I should take an extra tube or a patch kit on rides. Still can't decide.
Never had a flat on an organized ride. So now I guess I should expect one on the upcoming century in May since I said that.

And only five times has my wife come to pick me up for one.