It really depends.
Sometimes one has an obvious flat source and one can just pull a bit of tube out without even taking off wheel and patch and go. I've done this a few times.
Othertimes one takes out a tube and even then it can be hard to find the hole in the tube, then it easier to put a new tube back in (after ensuring no object still remains in tire)
Al