Sure. As long as it's light out. And not raining. And none of your fingers are broken. And the patch kit works.

I have found double-flats to be amazingly common: sometimes you just miss something stuck in the tire. I have had patch kits fail in the backcountry. A few extra ounces for a second spare is well worth the weight IMO, if you're riding far from civilization.