Ken, thanks for the feedback. I'd also posted this problem over in Foo and we came up with the same result. Either a Diode, or a different switch. At this point, since my switch mounting situation has changed somewhat, I am going to just go with two individual switches for the lights. This way I have more options of light output depending on the situation.
Waiting now for BF'er Jsharr to get back from vacation so I can borrow his drill press to get the lights mounted. As soon as I get it all hooked up I'll post photos.