In Virginia the code says

B. If the traffic lights controlling an intersection are out of service because of a power failure or other event that prevents the giving of signals by the traffic lights, the drivers of vehicles approaching such an intersection shall proceed as though such intersection were controlled by a stop sign on all approaches. The provisions of this subsection shall not apply to: intersections controlled by portable stop signs, intersections with law-enforcement officers or other authorized persons directing traffic, or intersections controlled by traffic lights displaying flashing red or flashing amber lights as provided in subsection A.

I know, it is a conundrum but I would maintain that I stopped, waited for traffic to clear, and proceeded as if the light was malfunctioning. Whether or not a cop would buy it is the question, or if the cop issues a citation whether the court would convict.