You need to run all your lights through a single switch so you can hit "emergency stealth mode" when necessary.

The other thing you could have done was try to talk to him and ask what was up from a semi-safe place (I.E. other side of a jersey wall median or something). But I agree, at 0345 I would be a tiny bit unsettled...

It could easily have been confusion on his part too, maybe what he yelled was "Can you show me how to get to XYZ" and your "sorry" sounded like "sure".